Procurement details: Provision of a Data Integration Platform - 2024UoS-1334

1. Context and requirements

Terms and acronyms

Summary of work

This innovation programme involves the University of Southampton committing to the development of a Microsoft Azure data integration platform. This platform is intended to support the categorisation, governance, storage, transfer, presentation, and utilisation of data. The ultimate goal is to transition the University of Southampton towards a more responsive operational model that enhances data literacy and uniformity, fosters collaboration, enables self-service capabilities, and stimulates innovation. It is envisaged that the supplier partner will build the data integration environment within the University's current well architected Azure tenancy and to provide technical capacity to setup a best practice integration platform within our current Azure tenancy and hand this over to our internal teams in a supported structure ready for BAU operational tasks and augment the University's integration engineering and development resources. It is also anticipated that supplier resources will be available for call off as and when required during the contract. The supplier will provide a recommendation of expected delivery resources for each call off task. We expect the partner to mentor and guide the UoS team in the implementation of best practice. The supplier will provide time and resource estimates to deliver and supplement the platform and (for example) integration flows based on t-Shirt sizing. An example structure might take the form: Access to a data team for 350 guaranteed days per annum under a specific SLA to provide UoS available capacity in the team to deliver on a backlog of project initiatives relating to the data initiative. This might be made up of the following capabilities: Data Architect Data Engineer Data Analyst Data Scientist Data Integration Specialist The partner will be responsible for creation and implementation of an effective delivery methodology. The 350 guaranteed days per annum are a baseline and any unused days should be rolled-over into the next contract year, conversely the University should be able to purchase additional days if required based on an agreed rate card. The University is undertaking this project in order to deliver the following benefits: 1 Sustainability The cloud plays an essential role in helping organisations become more sustainable. It facilitates a business case for a sustainable approach by reducing the carbon footprint and associated costs while fostering the research and innovation required to build a viable future. By virtue of its architecture, the cloud can reduce carbon emissions and facilitate sustainable innovation and research. But moreover, the cloud is where massive data analysis supported by a web of data networks allows scientists to identify and discover new methods to bring about lasting social and economic change. The sustainability business case for the cloud is quite simple: it reduces the on-premises footprint with power/cooling, hardware, and compute power. 2 Staff experience The implementation of a centralised data platform is anticipated to significantly enhance the user experience for staff. This enhancement includes better analytics and reporting capabilities, facilitating improved decision-making processes. This initiative is a key component of the overarching digital transformation strategy, aiming to optimise operational efficiency and data-driven insights across the organisation. 3 Student experience Students are expected to benefit from an improved end-user experience, characterized by enhanced analytics and reporting through the centralized data platform. This advancement supports more informed decision-making and the ability to make real-time updates to data, thereby eliminating the current delays. The initiative underscores a commitment to providing a responsive and data-informed educational environment. 4 Data Protection Compliance The adoption of a centralised data access mechanism, alongside the use of reusable interfaces, will significantly improve data governance within the organisation. This approach not only streamlines data management but also ensures compliance with data protection regulations, safeguarding sensitive information and enhancing overall data security governance by central data access mechanism and reusable interfaces. This procurement seeks to secure a partner to design and deliver on the University’s aspirations.

Where the supplied staff will work

No specific location (for example they can work remotely)

Who the organisation using the products or services is

Why the work is being done

Data is key University asset, which is crucial to the operation of the University and for enabling a more data driven organisation of the future. We need reliable data sources to be consumed in an efficient, safe, and effective way across multiple platforms such as Banner, IDM/IAM, Resource Link and Microsoft Dynamics (to name but a few) and it is critical to underpinning the capability of the University’s strategic digital ambitions. With the adoption of a new cloud based modern Data Integration platform, hosted on Microsoft Azure platform, it will empower the university with a modern tool set which is cost efficient and easy to use. It will enable out 0f the box integration with existing and future University systems. Whilst traditional systems require significant capital investment the flexible pricing models of Azure Integration Services offers consumption-based pricing models. This work is the key enabler to other aligned activity, which is focused on availability of secure, quality assured data sets. Data security is vital for the university to manage as the volume of data we collect continues to rise. Secure policies, procedures and rules will help to keep information safe and secure, both to maintain internal privacy and for the ongoing confidentiality of our users. The initial focus will be on prioritising critical areas such as student systems and then integration can be progressively augmented over a five-year period whilst retiring current technologies such as Microsoft Biztalk, which is currently used for enterprise application integration, and which is fast approaching end of life support from Microsoft. There will be a heavy reliance on testing throughout all phases of the project and will need to work with Faculty staff for Use Acceptance Testing. This project serves as a foundational core service for the University, underpinning the broader digital strategy and aligning to the Operational Excellence Strategic Plan. Without this Integration Platform the University will not be able to move towards a more responsible operational model, which enhances data literacy and uniformity, fosters collaboration, enables self service capabilities, and stimulates innovation. The ultimate goal is to transition University of Southampton towards a more secure, responsive operational model that enhances data literacy and uniformity, fosters collaboration, enables self-service capabilities, and stimulates innovation.

The business problem

The University operates a highly complex digital operating environment, with a wide range of systems have been deployed to support the numerous processes required of a modern higher education institution. Modelling, mapping, and transferring data between systems is an important underpinning capability, required to provide seamless service provision and support for an effective, compelling end user experience. A recent Data Strategy report from within the University identified several critical issues which negatively impact the experience of students and staff, the quality of executive-level reporting, research functions, and collaborations within the University’s partner network. Furthermore, the impending end-of-support status of key systems such as Microsoft Biztalk, currently used for enterprise application integration, underscores the urgent need for deployment of a contemporary data integration platform. The last version of Biztalk is Microsoft last planned release before they move to Cloud only alternatives. Therefore, there is a critical timeline to move from the current version to facilitate a move to the Cloud version as soon as possible, due to the size and complexity of the intended migration this will be a multiyear undertaking. These challenges and pain points underscore the implications of inaction and their current detrimental effect on University of Southampton as an institution. The issues can be broadly categorised into areas that presently serve as barriers to the organisational business performance.

The people who will use the product or service

User type

Data analysis and data engineering roles

Definition

define data structures, models, interfaces and integrations

User type

Report analysts

Definition

consume and present data via BI reporting tools

User type

Application developers

Definition

consume data via well defined APIs

Any pre-market engagement done

Work done so far

The University has an agreed business case (with funding) to deliver an Azure Cloud based integration platform. A proposed High Level Design has been completed - it is expected that the design be validated by the supplier and then implemented.

Which phase the project is in

Not applicable

Existing team

The planned project team consists of Team Manager, 6 Senior Data Engineers, Senior Reporting Engineer, Cloud Infrastructure Engineer and Senior Meta Data Engineer. Project Managers, business continuity manager, senior business analyst. Further work with the wider in-house applications teams is expected

Address where the work will be done

The supplier will be required to work primarily remote with occasional physical presence in our Southampton City Centre office to attend planning and design workshops. Expenses for on site workshops will be capped at £500 / day for the duration of the contract, and all travel and subsistence will require prior approval.

Working arrangements

The supplier will be required to work primarily remote with occasional physical presence in our Southampton City Centre office to attend planning and design workshops. Expenses for on site workshops will be capped at £500 / day for the duration of the contract, and all travel and subsistence will require prior approval.

Security and vetting requirements

Baseline Personnel Security Standard (BPSS)

Latest start date

30 October 2024

Expected contract length

Contract length

2 years 0 months 0 days

Optional extension

1 years 0 months 0 days

Special terms and conditions

special term or condition

The Insurance levels required for this tender have been amended to include the requirement for bidders to hold £5,000,000 Cyber Liability Insurance. Please see the Annex to (File 5) Call Off Conditions of Contract – Joint Schedule 3 for full insurance requirement details.

Budget

Indicative maximum

£1740000

Indicative minimum

The contract value is not specified by the buyer

Further information

The estimated Contract value is £1,740,000 GBP (excluding VAT). This figure is based on a project budget of £690,000 for delivery of the specified requirements (including 350 days guaranteed resource to augment the UoS team) for the full term of the Contract, with the option to purchase additional resource days throughout the term of the Contract, as required and up to a total overall spend of £1,740,000. The University reminds tenderers that commercial responses must be submitted in accordance with the Framework pricing agreed as part of the original tender process. Therefore, commercial proposals must not exceed the published framework rates. Tenderers may consider reducing their rates in order to submit a more competitive response at Further Competition Stage. Details of current expenditure or potential future uptake are given as a guide based on past purchasing and current planning to assist you in the preparation of your response. They should not be interpreted as an undertaking to purchase any goods or services to any particular value and do not form part of the Contract.

Contracted out service or supply of resource?

Contracted out service: the off-payroll rules do not apply

2. Assessment criteria

How many suppliers to evaluate

5

Technical Competence

50%

Cultural fit

10%

Social values

10%

Price

30%

Technical competence

Essential skills and experience

10%

Nice-to-have skills and experience

Technical questions

90%

Essential skills and experience

Description

Please refer to the supporting documents. 1. Please provide an introduction to your organisation’s technical capabilities. Describe where you have used those skills to support the creation or augmentation of data / integration / analytics strategies and capabilities that underpin a UK HE University's (or similar complex organisational environment) high level strategic direction.

Weighting

8%

Description

2. The bidder must be a Microsoft Solutions Partner in at least two disciplines from Azure, Azure Data and AI, Data and AI Analytics, Digital and App innovation, please confirm that you meet this requirement and list the disciplines.

Weighting

6%

Description

3. The bidder must have proven experience designing and delivering solutions architecture, data architecture, data integration and data analytics services to support complex data landscape transition to Azure public cloud data integration and/or data platform capabilities as part of significant platform transformation programmes within the UK Higher Education vertical or similar complex organisational environment. Please describe your relevant experience.

Weighting

10%

Description

4. The bidder should have demonstrable experience carrying out as-is analysis of current technology landscapes, including integration interfaces, to support definition of business requirements and proposed benefits for use in business cases for consumption by senior management. Please describe your relevant experience.

Weighting

10%

Description

5. Please provide details of a project delivery of a similar scope and scale within the last 3 years.

Weighting

10%

Description

6. The bidder must have proven experience in creating data platform solution designs which provide improved capabilities while ensuring data legitimacy and governance. Please describe your relevant experience.

Weighting

8%

Description

7. The bidder must have proven experience of modelling and producing options proposals and recommendations of benefits, costs and risks relating to architecture of data consolidation stores e.g. Data lake, data warehouse, analytics platforms. Please describe your relevant experience.

Weighting

6%

Description

8. The bidder must have significant experience designing analytics components (native Azure or Azure integrated third party tools) and data structures in support of university business intelligence (to Power BI). Please describe your relevant experience.

Weighting

6%

Description

9. The bidder must have proven experience planning and implementing migration strategies to move from legacy integration platforms (eg: Biztalk / SSIS) to Azure data platform services. Please describe your relevant experience.

Weighting

6%

Description

10. The bidder must have proven experience of supporting customers to build in-house integration configurations through effective knowledge management and transfer including training, coaching and mentoring for university staff. Please describe your relevant experience and how you have assisted previous client teams to attain relevant recognised qualifications.

Weighting

6%

Description

11. The bidder must be able to offer tried and tested managed service offerings which offer measurable, SLA backed capabilities to ensure successful day to day platform performance. Please describe your managed service offering.

Weighting

6%

Description

12. The bidder must have proven experience in a collaborative and flexible working approach, e.g. working with in-house technical and other digital specialists. Please describe your relevant experience.

Weighting

6%

Description

13. The bidder must have proven experience and a working knowledge of relevant regulations and compliance constraints e.g. GDPR. Please describe your relevant experience.

Weighting

6%

Description

14. Describe your experience working on data interoperability and integration between systems specific to UK Higher Education. Specific examples in use at the University of Southampton include Ellucian Banner, Anthology Blackboard, TechnologyOne Scientia, and Worktribe Curriculum / Research management.

Weighting

6%

Nice-to-have skills and experience

Description

Weighting

Technical questions

Question

Please refer to the supporting documents, only shortlisted suppliers will be required to complete the technical questions in (File 4).

Weighting

100%

Cultural fit questions

Question

Please refer to the supporting documents, only shortlisted suppliers will be required to complete the cultural fit questions in (File 4).

Weighting

100%

Social value questions

Question

Please refer to the supporting documents, only shortlisted suppliers will be required to complete the social value questions in (File 4).

Weighting

100%

Pricing model

Capped time and materials

Additional assessment methods

Presentation

Question and answer session details

How suppliers will be scored

Level

Non-Compliant

Score

0

Description

The response by the Bidder is non-compliant; the response gives rise to many concerns about being able to support the achievement of the intended outcomes of the Project. And/or The response has insufficient detail with virtually no appropriate explanations and supporting evidence, there are many minor issues and a high number of major issues. And/or The response demonstrates fewer strengths than weaknesses, desired standards are highly unlikely to be met.

Level

Many Concerns

Score

1

Description

The response by the Bidder gives rise to many concerns about being able to support the achievement of the intended outcomes of the Project. And/or The response has limited detail with limited appropriate explanations and supporting evidence, there are many minor issues and a high number of major issues. And/or The response demonstrates fewer strengths than weaknesses, desired standards are unlikely to be met.

Level

Some Concerns

Score

2

Description

The response by the Bidder gives rise to some concerns about being able to support the achievement of the intended outcomes of the Project. And/or The response has limited detail with limited appropriate explanations and supporting evidence, there are a number of minor issues and a number of major issues. And/or The response demonstrates fewer strengths than weaknesses, desired standards may not be met.

Level

Acceptable

Score

3

Description

The response by the Bidder provides an acceptable degree of confidence of being able to support the achievement of the intended outcomes of the Project. And/or The response is sufficiently detailed with some appropriate explanations and supporting evidence, there are a number of minor issues and a limited number of major issues. And/or The response demonstrates more strengths than weaknesses, desired standards will be materially met.

Level

Good

Score

4

Description

The response by the Bidder provides a high degree of confidence of being able to support the achievement of the intended outcomes of the Project. And/or The response is detailed with appropriate explanations relevant and tailored to the project and supporting evidence, there are a number of minor issues and a limited number of major issues. And/or The response demonstrates more strengths than weaknesses, desired standards will be met in most respects.

Level

Excellent

Score

5

Description

The response by the Bidder provides a very high degree of confidence of being able to support the achievement of the intended outcomes of the Project. And/or The response is fully detailed with appropriate explanations relevant and tailored to the project and supporting evidence, there are a limited number of minor issues and no major issues. And or The response demonstrates many more strengths than weaknesses, desired standards will be met in all respects.

3. Timeline

Publication of stage 1

26/07/2024

Clarification period closes

02/08/2024 10:00

Deadline for suppliers to submit their stage 1 responses

09/08/2024 12:00