Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Follow the steps below to develop a BUCP under the IDEA. Typically, a BUCP will be initiated by a Data Recipient to request data from a Data Provider. However, all parties may work together to develop a BUCP. These two roles are referred to throughout this guidebook and in the IDEA and BUCP template.
Flowchart: We’ve created a flowchart that supports the steps below.
The IDEA is designed for data that requires protection and cannot be freely shared across state entities. Typically this means the data faces restrictions on disclosures to other state entities under federal or state law due to privacy or security reasons.
The IDEA does not apply to public, non-confidential data. In addition, it does not apply to non-confidential, internal use data that you share with other state entities even if the data is not intended for public use. For these cases, treat data sharing as a normal part of business.
All state agencies under the Governor’s authority and their reporting departments have signed IDEA, in addition to several other entities. Confirm that the Data Recipient(s) and the Data Provider(s) are signatories on the agreement. If one or the other is not a signatory, you are welcome to use the IDEA agreement and BUCP templates as a starting point but are not required to do so. We encourage the entity that has not yet signed onto IDEA to do so and are happy to review it with them.
See the list of signatories to confirm
The BUCP template is the document you will use to finalize your data sharing agreement. The Data Recipient’s program staff who will use the data should draft the initial BUCP. At this time, work with the program team to develop this draft. Later in the process, you can engage your Data Officer and Legal team. The template is broken down into the following sections:
Section
Description
How to use at this stage
Signatures and Approvals
This is a set of legal, privacy, and program approvals dates as well as the start and end date for data exchange. While at the beginning of the template, this is the last step in the process.
Leave blank for now. This is part of the discussion process.
Business Case Fields
Fields that provide an overview of the program and business needs for this data along with basic contact information.
Complete initial draft. The Data Recipient is primarily responsible for completing these fields.
Technical Fields
Fields that describe the data in detail as well as the means of transfer and management, including destruction and/or return.
Complete initial draft. The Data Recipient and Data Provider will need to iterate on this during discussions.
Administrative Fields
Fields that address risks, legal authority, transfer of funds, and additional protections or approvals.
Draft fields as possible. The Data Provider will need to help complete these fields based on discussion with the Data Recipient.
Once the Data Recipient has a working draft BUCP, they should identify the appropriate contact at the Data Provider. A good initial starting point is the program contacts for the data, who are in the best position to help you develop the BUCP. They can bring in additional groups as necessary including legal, privacy, technology, and security.
At this time, we do not yet have a point of contact by state entity for BUCPs.
You can start with the email template to initiate a request
All entities’ programs should work together to complete a draft BUCP for approval. Typically, a completed draft will require input from your legal, privacy, security, and technology teams.
If there is a dispute while developing the BUCP, please follow the dispute resolution process. Disputes fall into three categories:
Data Provider objects to the data exchange
Disagreement on the method for de-identification
Disagreement on costs
See related templates for Planning for a BUCP kickoff meeting
The Data Recipient must file the final BUCP via the BUCP Inventory Form (external link to AirTable). This is for tracking and auditing purposes only (there is no 'approval' that happens by CalData). Once submitted you should move immediately to Step 7 to begin exchanging the data.
Follow the terms of the agreement to exchange and manage the data. Below we included a series of templates that may be useful under several of IDEA’s clauses.
IDEA recognizes two instances in which a Data Provider may file a notice of termination.
If the termination is due to statutory, regulatory, or contractual changes, under §5.14 of IDEA, the Data Provider must notify the Agency Chief Data Officer or the Agency Information Officer of the action and reasons.
Under §7.4 of IDEA, if the Data Provider determines that the Data Recipient has violated a material term of the agreement, they may terminate the agreement. The Data Provider must immediately notify the Data Recipient and Chief Data Officer.
Subject: Request to exchange data under IDEA
Dear <insert Data Provider contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities. If you are unfamiliar with IDEA, you can learn more in the attached FAQ.
We are interested in exchanging the following information with your department and have drafted an initial Business Use Case Proposal (BUCP) as required by IDEA.
<Insert brief description of data and purpose>
At your convenience, we would like to meet and discuss this request with you. If you feel another contact is more appropriate, please feel free to let us know.
Best,
<insert Data Recipient name>
Use this template to plan for your BUCP Kickoff Meeting.
Suggested attendees:
Data Recipient. Program contacts that are responsible for the business use case.
Data Providers. Program contacts that have a deep understanding of the data to exchange and can inform and even advise on the business use case needs.
Inputs to meeting:
Draft of BUCP (provided by Data Recipient)
List of available data fields to review and discuss (provided by Data Provider)
Meeting objective: Refine business use case needs and develop preliminary list of data fields
Meeting agenda:
Introductions (All parties)
Background on business use case purpose and importance (Data Recipient)
Discussion of data needs in support of use case (All parties). Use this time to list and start to refine the list of data fields that would meet business use case. Flag (but don’t attempt to resolve) issues that would require legal or security input.
Identify next steps. Next steps should include at a minimum the following:
How to finalize list of data elements that are in scope
Legal and security input needed
Subject: Notice of unauthorized access to data exchanged under IDEA
Dear <insert Data Provider contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.
Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which you provided us with the following data: <insert brief description of data>.
Under provision 8.5 of IDEA, we are required to notify you that we experienced an instance of unauthorized access as follows:
<insert brief description of unauthorized access>.
Please let us know if you need any additional information to assess this instance of unauthorized access. We are able to meet at a time of your convenience. Further, our team is reviewing this instance of unauthorized access and identifying any remediations and future mitigation measures to prevent any future unauthorized access.
Best,
<insert Data Recipient name>
Subject: Notice of security incident involving data exchanged under IDEA
Dear <insert Data Provider contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memo of understanding that is intended to facilitate data exchange between state entities.
Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which you provided us with the following data: <insert brief description of data>.
Under provision 8.6 of IDEA, we are required to notify you that we experienced a security incident relating to this data:
<insert brief description of unauthorized access and consider attaching a more detailed report>.
Please let us know if you need any additional information to assess this incident. We are able to meet at a time of your convenience. Further, our team is reviewing this incident and identifying any remediations and future mitigation measures to prevent any future security incidents.
Best,
<insert Data Recipient name>
Under IDEA, a Data Recipient may modify data and disclose it consistent with the signed BUCP. If disclosed, the Data Recipient must indicate that the data is modified and not original. We suggest including a footnote as follows:
Note: Our department is not the original source of this data. We have modified this data to support our own business needs. Any inconsistency with the original data is our responsibility.
Subject: Notice to terminate data exchange under IDEA
CC: Agency Chief Data Officer or the Agency Information Officer
Dear <insert Data Recipient contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.
Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.
Under provision 5.14 of IDEA, we are terminating this agreement due to the following statutory, regulatory, or contractual change which now prohibits our ability to share the data under our BUCP:
<insert brief description of change and why this requires a termination and any time constraints or requirements for deletion/removal; consider attaching a more detailed report>.
We request to meet and discuss the steps involved in this termination.
Best,
<insert Data Provider name>
Subject: Notice to terminate data exchange under IDEA
CC: Agency Chief Data Officer or the Agency Information Officer
Dear <insert Data Recipient contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.
Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.
Under provision 5.14 of IDEA, we are terminating this agreement due to your act as described below:
<insert brief description of Data Recipeint’s act that prompted this termination and why that act should lead to a termination. Describe time constraints or requirements for deletion/removal; consider attaching a more detailed report>.
We request to meet and discuss the steps involved in this termination.
Best,
<insert Data Provider name>
Subject: Notice to terminate data exchange under IDEA due to cause
CC: Statewide Chief Data Officer and Agency Chief Data Officer or the Agency Information Officer
Dear <insert Data Recipient contact name>,
We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.
Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.
Under provision 7.4 of IDEA, we request to terminate this agreement as we believe you, the Data Recipient has violated a material term of our agreement:
<insert brief description of violation and why this requires a termination and any time constraints or requirements for deletion/removal; consider attaching a more detailed report>.
We request to meet and discuss the steps involved in this termination.
Best,
<insert Data Provider name>
Use the Dispute Resolution Process to mediate disagreements in any of the following categories:
Data Provider objects to the data exchange
Disagreement on the method for de-identification
Disagreement on costs
The goal of the dispute resolution process is to resolve issues at the lowest level possible and to create a different process when one of the parties to the BUCP is not under the authority of the Governor.
Determine if both state entities are under the authority of the Governor.
If yes, escalate the issue to your respective Agency Chief Data Officers, if applicable, else the Agency Information Officer for a mediation meeting.
If this resolves the dispute, finalize the BUCP and file it via the BUCP Inventory Form (external link to AirTable).
If the dispute is not resolved, proceed to step 3.
If not, continue to step 2.
Both the Data Provider and Data Recipient must develop written comments and recommendations that represent their perspective.
Both must compile and submit this documentation to the Chief Data Officer via the Dispute Mediation Request Form (external link to AirTable).
Conduct joint mediation meetings.
If this resolves the dispute, finalize the BUCP and file it via the BUCP Inventory Form (external link to AirTable).
If this does not resolve the dispute:
And both entities are under the authority of the Governor, the Chief Data Officer will submit a recommendation to the Governor’s office for final decision.
And one or more of the entities are not under the authority of the Governor, the BUCP is not approved.
See the flowchart below as well.
This page contains both the BUCP template itself as well as a template for defining the data elements that may be used or adapted as the BUCP is developed.
Use this Word document to draft your BUCPs. If needed, we will periodically update this based on feedback and include version notes.
Remember when you complete your BUCP to
One of the best ways to improve data use is to provide data that is well-documented. The data field definitions table below will help both the Data Provider and Recipient develop a shared understanding of the data to be exchanged.
This is a list of all state entities that have signed the agreement. This list is updated whenever a new signatory is added.
Please if you note any errors.
This is the final agreement between agency secretaries, including appendices. Note that this public version is unsigned. Additional signatories were added via addendum.
State employees can find the signed agreement in the .
IDEA was borne out of a need to improve sharing infrastructure within the state. Learn more about its history, benefits and implementation in the material below.
In this section you will find key templates and other information to execute and understand the IDEA process. These materials are linked throughout the guide.
This section includes:
Field
Description
Field Name
What is a brief human readable name for the field? This should be unique and stated in the singular. Don't use abbreviations or acronyms.
Type
What is the format of the data? Numeric, text, data and time, currency, boolean, coordinates, other.
Definition
Define the field. State it as a descriptive phrase or sentence. Be precise, unambiguous and concise. Make it unique and state it in the singular. State what it is, not what it is not. Can it stand alone? Define units of measure (e.g. miles or meters or feet).
Required
Yes or No. Is this field required or optional?
Valid inputs
For categories, what is the list of allowable values? For date and numbers, what is the allowable range?
Source
Defines how the data enters the system.
Notes
Describe any known data quality issues or concerns.
Guide for use
Provide advice on how the field can be used.
Version 1.2 | Last Updated Aug 24, 2022
The Interagency Data Exchange Agreement is managed by the Statewide Chief Data Officer who sits within the Office of Data and Innovation
This guidebook is designed to help you use the Interagency Data Exchange Agreement (IDEA). IDEA is an umbrella Memorandum of Understanding (MOU) that is intended to facilitate data exchange between state entities in California.
The IDEA consists of two parts:
one single master agreement with general legal boilerplate language and
smaller subordinate agreements for instances of data exchange called “Business Use Case Proposals (BUCP)”, containing specific information such as data type, intended use, etc.
The master agreement combined with a BUCP will form the complete standardized legally compliant data sharing agreement.
The concept is like the procurement model provided by the California Multiple Award Schedules (CMAS). Vendors sign onto a general master agreement (CMAS) and then state entities produce smaller and more detailed Requests for Offers (RFOs). Both parts together form the complete contract.
Version
Date
Name
Notes
1.0
2021.06.24
Joy Bonaguro
Initial release of guidebook
1.1
2021.08.05
Joy Bonaguro
Added new FAQ on fund transfers
1.2
2022.08.24
Joy Bonaguro
Gitbook version release, adding and organizing FAQs, adding resources
IDEA applies to data that is protected by state or federal law typically due to privacy or security concerns. In short, this is data that must be assessed to ensure that exchange is allowable and secure under any prevailing statute or regulation. This typically includes personally identifiable information (PII) or highly sensitive information such as that related to security. This does not apply to data that is public or even used for internal purposes but not rising to the level of protected information. Typically, protected information is that which faces specific requirements for disclosure and allowable use or for breaches (often called notice-triggering events).
Yes, if your department or entity is a signatory to IDEA. The goal of IDEA is to reduce administrative overhead by using the same framework for data exchange versus renegotiating the same questions. It also helps ensure that the data exchange uses consistent privacy and security practices.
Any state entity is encouraged to and can sign onto the IDEA. As of March 2022, the UCs, CSUs, and Community Colleges have not yet done so. Please refer to the list of signature entities for current status.
No. Any data exchange must be allowable under governing statute and regulation. State entities retain authority to sign and allow or decline data exchange under a BUCP.
Yes, if the research requires sensitive data from another state entity that has signed the IDEA. This includes cases where the state entity is using a service provider to conduct the research on the entity’s behalf. Importantly, IDEA does not replace any existing approval processes for independent research. For example, a BUCP for research-related data from a university will need to include Institutional Review Board (IRB) approval. See the BUCP template and Section 3 of IDEA for more details. Requests for data by external researchers, either academics or institutions, for research purposes are covered by other existing processes and IDEA should not be used.
You can leave existing agreements as is. However, any renewals or new agreements should use the BUCP process.
Yes. While the BUCP includes a termination date, data exchanges can be ongoing or terminated by notice as long as the law allows it.
IDEA establishes minimum security requirements by requiring that Signatory Entities meet Chapter 5300 of the State Administrative Manual. Additional security and privacy requirements can be included in the BUCP. Any additional requirements should be commensurate with risk or due to prevailing rules or regulations.
You should limit data exchange to that which is necessary to meet the business need or objective. Wherever possible, data should be de-identified if individual identifiers are not necessary. For example, while the business case may require record level data, it may not require known identifiers such as name, address, or phone number. In addition, if aggregated data meets the use case aggregate data should be used. Moreover, data that has been de-identified and suppressed can be published in an open data portal.
The Data Recipient should contact the Data Provider to identify who is responsible for notification under §9.2 of IDEA. If the breach involves HIPAA-protected data held by a Covered Entity or its Business Associate, the parties must follow breach provisions in Addendum A of IDEA.
Case 1: If two or more departments want to share data and transfer funds, the contractual process can run in parallel to the BUCP approval process. For example, data exchange can be addressed by the BUCP and the transfer of funds or services can be addressed by an Interagency Agreement. To avoid work duplication, attach the BUCP as an exhibit to the Interagency Agreement.
Case 2: If two or more programs within the same department want to share data and transfer funds, the contractual process can also run in parallel to the BUCP approval process. For example, data exchange can be addressed by the BUCP and the transfer of funds or services can be addressed by a Memorandum of Agreement. To avoid work duplication, attach the BUCP as an exhibit to the Memorandum of Agreement.
Work with your legal and privacy team to determine if your existing BUCPs are still allowable under the rule change.
If they are still allowable, update the BUCP to reflect the new legal analysis under the legal authority and refile the BUCP via the BUCP Inventory Form.
If the data exchange is no longer permitted, see Step 8 in the guidebook on filing a notice of termination.
If a Data Recipient receives a request under the California Public Records Act (CPRA), a subpoena, a court order, a litigation-related request, or any other request for the data under a BUCP, under §5.18 of IDEA, immediately notify the Data Provider to meet and confer on the appropriate response.
Yes. Data that is shared consistent with the Information Practices Act, other laws covering the data, or to a governmental agency that agrees to keep the data confidential means that the data keeps its confidential status (see Government Code § 6254.5). The IDEA itself is an agreement to keep confidential data that is shared as confidential. Sharing of confidential data with other governmental agencies, contractors or business associates is permitted, and confidential information shared via IDEA will generally remain confidential and exempt from PRA. See §5.18 of IDEA and FAQ 8 for details on managing PRA requests.
No. Per §5.20 of IDEA, nothing in the IDEA or BUCP will diminish any privileges or protections.
We expect the following benefits from the IDEA:
Reduction in time and effort spent negotiating terms. After CHHS adopted a single agency agreement, completion time went from 2-3 years on average to 79 days.
Shifts bias to sharing and working together. Most data sharing negotiations are adversarial and start from a position of “no.” The IDEA starts with a commitment to data sharing and collaboration to improve services.
Reduction in duplication of resources and workload. The IDEA establishes the legal framework so the focus moves from creation of a legal agreement towards developing the data elements and transmission logistics. CHHS statistics show data is often transferred earlier than the projected date.
Greater visibility into areas of disagreement. The IDEA establishes an escalation process for when agencies don’t agree to share that could uncover both cultural reluctance and/or legal issues that need to be addressed.
Ultimately, better government services through the improved sharing and use of data.
The IDEA process is relatively new, and we want to give it time to take root. As its usage expands, we are eager to understand what is working and where there may be gaps. If you have just completed a BUCP, there is an opportunity to let us know what you think on the inventory form. At any other point you can submit feedback using our feedback form. In time, based on feedback, we will determine if there is the need to revisit and update the IDEA or BUCP templates. If there are updates, they would likely only apply to future agreements.