arrow-left
Only this pageAll pages
gitbookPowered by GitBook
1 of 10

Interagency Data Exchange (IDEA) Guidebook

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Loading...

Dispute Resolution Process

Use the Dispute Resolution Process to mediate disagreements in any of the following categories:

  1. Data Provider objects to the data exchange

  2. Disagreement on the method for de-identification

  3. Disagreement on costs

The goal of the dispute resolution process is to resolve issues at the lowest level possible and to create a different process when one of the parties to the BUCP is not under the authority of the Governor.

hashtag
Steps in the dispute resolution process

  1. Determine if both state entities are under the authority of the Governor.

    1. If yes, escalate the issue to your respective Agency Chief Data Officers, if applicable, else the Agency Information Officer for a mediation meeting.

      1. If this resolves the dispute, finalize the BUCP and file it via the

See the flowchart below as well.

hashtag

hashtag

Interagency Data Exchange (IDEA) Guidebook

Version 1.2 | Last Updated Aug 24, 2022

circle-info

The Interagency Data Exchange Agreement is managed by the Statewide Chief Data Officer who sits within the Office of Data and Innovationarrow-up-right

hashtag
Introduction

This guidebook is designed to help you use the Interagency Data Exchange Agreement (IDEA). IDEA is an umbrella Memorandum of Understanding (MOU) that is intended to facilitate data exchange between state entities in California.

The IDEA consists of two parts:

  1. one single master agreement with general legal boilerplate language and

  2. smaller subordinate agreements for instances of data exchange called “Business Use Case Proposals (BUCP)”, containing specific information such as data type, intended use, etc.

The master agreement combined with a BUCP will form the complete standardized legally compliant data sharing agreement.

The concept is like the procurement model provided by the California Multiple Award Schedules (CMAS). Vendors sign onto a general master agreement (CMAS) and then state entities produce smaller and more detailed Requests for Offers (RFOs). Both parts together form the complete contract.

hashtag
Version Notes

(external link to AirTable).
  • If the dispute is not resolved, proceed to step 3.

  • If not, continue to step 2.

  • Both the Data Provider and Data Recipient must develop written comments and recommendations that represent their perspective.

  • Both must compile and submit this documentation to the Chief Data Officer via the Dispute Mediation Request Formarrow-up-right (external link to AirTable).

  • Conduct joint mediation meetings.

    1. If this resolves the dispute, finalize the BUCP and file it via the BUCP Inventory Formarrow-up-right (external link to AirTable).

    2. If this does not resolve the dispute:

      1. And both entities are under the authority of the Governor, the Chief Data Officer will submit a recommendation to the Governor’s office for final decision.

      2. And one or more of the entities are not under the authority of the Governor, the BUCP is not approved.

  • BUCP Inventory Formarrow-up-right

    Joy Bonaguro

    Gitbook version release, adding and organizing FAQs, adding resources

    Version

    Date

    Name

    Notes

    1.0

    2021.06.24

    Joy Bonaguro

    Initial release of guidebook

    1.1

    2021.08.05

    Joy Bonaguro

    Added new FAQ on fund transfers

    1.2

    2022.08.24

    How to develop and manage a data sharing agreement

    Follow the steps below to develop a BUCP under the IDEA. Typically, a BUCP will be initiated by a Data Recipient to request data from a Data Provider. However, all parties may work together to develop a BUCP. These two roles are referred to throughout this guidebook and in the IDEA and BUCP template.

    Flowchart: We’ve created a flowchart that supports the steps below.

    hashtag
    Step 1. Determine if you need to use the IDEA

    The IDEA is designed for data that requires protection and cannot be freely shared across state entities. Typically this means the data faces restrictions on disclosures to other state entities under federal or state law due to privacy or security reasons.

    The IDEA does not apply to public, non-confidential data. In addition, it does not apply to non-confidential, internal use data that you share with other state entities even if the data is not intended for public use. For these cases, treat data sharing as a normal part of business.

    hashtag
    Step 2. Confirm that all parties are signatories to IDEA

    All state agencies under the Governor’s authority and their reporting departments have signed IDEA, in addition to several other entities. Confirm that the Data Recipient(s) and the Data Provider(s) are signatories on the agreement. If one or the other is not a signatory, you are welcome to use the IDEA agreement and BUCP templates as a starting point but are not required to do so. We encourage the entity that has not yet signed onto IDEA to do so and are happy to review it with them.

    circle-info

    See the to confirm

    hashtag
    Step 3. Draft initial Business Use Case Proposal (BUCP)

    The is the document you will use to finalize your data sharing agreement. The Data Recipient’s program staff who will use the data should draft the initial BUCP. At this time, work with the program team to develop this draft. Later in the process, you can engage your Data Officer and Legal team. The template is broken down into the following sections:

    hashtag
    Step 4. Submit the draft BUCP to the Data Provider

    Once the Data Recipient has a working draft BUCP, they should identify the appropriate contact at the Data Provider. A good initial starting point is the program contacts for the data, who are in the best position to help you develop the BUCP. They can bring in additional groups as necessary including legal, privacy, technology, and security.

    circle-exclamation

    At this time, we do not yet have a point of contact by state entity for BUCPs.

    circle-info

    You can start with

    hashtag
    Step 5. Work together to complete the BUCP

    All entities’ programs should work together to complete a draft BUCP for approval. Typically, a completed draft will require input from your legal, privacy, security, and technology teams.

    If there is a dispute while developing the BUCP, please follow the . Disputes fall into three categories:

    1. Data Provider objects to the data exchange

    2. Disagreement on the method for de-identification

    3. Disagreement on costs

    circle-info

    See related templates for

    hashtag
    Step 6. Submit the final BUCP to the Statewide Chief Data Officer

    The Data Recipient must file the final BUCP via the (external link to AirTable). This is for tracking and auditing purposes only (there is no 'approval' that happens by CalData). Once submitted you should move immediately to Step 7 to begin exchanging the data.

    hashtag
    Step 7. Exchange and manage the data per the agreement

    Follow the terms of the agreement to exchange and manage the data. Below we included a that may be useful under several of IDEA’s clauses.

    circle-info

    Useful templates:

    hashtag
    Step 8. (If applicable) file a notice of termination

    IDEA recognizes two instances in which a Data Provider may file a notice of termination.

    1. If the termination is due to statutory, regulatory, or contractual changes, under §5.14 of IDEA, the Data Provider must notify the Agency Chief Data Officer or the Agency Information Officer of the action and reasons.

    2. Under §7.4 of IDEA, if the Data Provider determines that the Data Recipient has violated a material term of the agreement, they may terminate the agreement. The Data Provider must immediately notify the Data Recipient and Chief Data Officer.

    circle-info

    Useful templates:

    hashtag
    Flowchart for Managing Data Sharing Agreements

    Draft fields as possible. The Data Provider will need to help complete these fields based on discussion with the Data Recipient.

  • Data disclosure language (provision 5.11)

  • Data Field Definitions Template

  • Notice to terminate data exchange under IDEA (provision 7.4)

  • Section

    Description

    How to use at this stage

    Signatures and Approvals

    This is a set of legal, privacy, and program approvals dates as well as the start and end date for data exchange. While at the beginning of the template, this is the last step in the process.

    Leave blank for now. This is part of the discussion process.

    Business Case Fields

    Fields that provide an overview of the program and business needs for this data along with basic contact information.

    Complete initial draft. The Data Recipient is primarily responsible for completing these fields.

    Technical Fields

    Fields that describe the data in detail as well as the means of transfer and management, including destruction and/or return.

    Complete initial draft. The Data Recipient and Data Provider will need to iterate on this during discussions.

    Administrative Fields

    list of signatories
    BUCP template
    the email template to initiate a request
    dispute resolution process
    Planning for a BUCP kickoff meeting
    BUCP Inventory Formarrow-up-right
    series of templates
    Notice of unauthorized access (provision 8.5)
    Notice of security incident (provision 8.6)
    Notice to terminate data exchange under IDEA (provision 5.14 - rule change)
    Notice to terminate data exchange under IDEA (provision 5.14 - Data Recipient’s Acts)

    Fields that address risks, legal authority, transfer of funds, and additional protections or approvals.

    IDEA Agreement

    This is the final agreement between agency secretaries, including appendices. Note that this public version is unsigned. Additional signatories were added via addendum.

    State employees can find the signed agreement in the .

    Resources and References

    In this section you will find key templates and other information to execute and understand the IDEA process. These materials are linked throughout the guide.

    This section includes:

    file-pdf
    262KB
    Final_IDEA.pdf
    PDF
    arrow-up-right-from-squareOpen
    teams channelarrow-up-right

    BUCP template

  • Notice, Email and Disclosure templates

  • Background materials

  • IDEA agreement
    List of signatories

    BUCP Template

    This page contains both the BUCP template itself as well as a template for defining the data elements that may be used or adapted as the BUCP is developed.

    hashtag
    Template: BUCP

    Use this Word document to draft your BUCPs. If needed, we will periodically update this based on feedback and include version notes.

    file-download
    37KB
    BUCP-Template-V1.0.docx
    arrow-up-right-from-squareOpen
    circle-info

    Remember when you complete your BUCP to

    hashtag
    Template: Data Field Definitions Template

    One of the best ways to improve data use is to provide data that is well-documented. The data field definitions table below will help both the Data Provider and Recipient develop a shared understanding of the data to be exchanged.

    hashtag

    Defines how the data enters the system.

    Notes

    Describe any known data quality issues or concerns.

    Guide for use

    Provide advice on how the field can be used.

    Field

    Description

    Field Name

    What is a brief human readable name for the field? This should be unique and stated in the singular. Don't use abbreviations or acronyms.

    Type

    What is the format of the data? Numeric, text, data and time, currency, boolean, coordinates, other.

    Definition

    Define the field. State it as a descriptive phrase or sentence. Be precise, unambiguous and concise. Make it unique and state it in the singular. State what it is, not what it is not. Can it stand alone? Define units of measure (e.g. miles or meters or feet).

    Required

    Yes or No. Is this field required or optional?

    Valid inputs

    For categories, what is the list of allowable values? For date and numbers, what is the allowable range?

    submit to the Statewide Chief Data Officerarrow-up-right

    Source

    Notice, Email and Disclosure Templates

    hashtag
    Template: Email to initiate a data exchange under IDEA

    Subject: Request to exchange data under IDEA

    Dear <insert Data Provider contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities. If you are unfamiliar with IDEA, you can learn more in the attached FAQ.

    We are interested in exchanging the following information with your department and have drafted an initial Business Use Case Proposal (BUCP) as required by IDEA.

    <Insert brief description of data and purpose>

    At your convenience, we would like to meet and discuss this request with you. If you feel another contact is more appropriate, please feel free to let us know.

    Best,

    <insert Data Recipient name>

    hashtag
    Template: Planning for a BUCP Kickoff Meeting

    Use this template to plan for your BUCP Kickoff Meeting.

    Suggested attendees:

    • Data Recipient. Program contacts that are responsible for the business use case.

    • Data Providers. Program contacts that have a deep understanding of the data to exchange and can inform and even advise on the business use case needs.

    Inputs to meeting:

    • Draft of BUCP (provided by Data Recipient)

    • List of available data fields to review and discuss (provided by Data Provider)

    Meeting objective: Refine business use case needs and develop preliminary list of data fields

    Meeting agenda:

    1. Introductions (All parties)

    2. Background on business use case purpose and importance (Data Recipient)

    3. Discussion of data needs in support of use case (All parties). Use this time to list and start to refine the list of data fields that would meet business use case. Flag (but don’t attempt to resolve) issues that would require legal or security input.

    4. Identify next steps. Next steps should include at a minimum the following:

      1. How to finalize list of data elements that are in scope

      2. Legal and security input needed

    hashtag
    Template: Notice of unauthorized access (provision 8.5)

    Subject: Notice of unauthorized access to data exchanged under IDEA

    Dear <insert Data Provider contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.

    Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which you provided us with the following data: <insert brief description of data>.

    Under provision 8.5 of IDEA, we are required to notify you that we experienced an instance of unauthorized access as follows:

    <insert brief description of unauthorized access>.

    Please let us know if you need any additional information to assess this instance of unauthorized access. We are able to meet at a time of your convenience. Further, our team is reviewing this instance of unauthorized access and identifying any remediations and future mitigation measures to prevent any future unauthorized access.

    Best,

    <insert Data Recipient name>

    hashtag
    Template: Notice of security incident (provision 8.6)

    Subject: Notice of security incident involving data exchanged under IDEA

    Dear <insert Data Provider contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memo of understanding that is intended to facilitate data exchange between state entities.

    Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which you provided us with the following data: <insert brief description of data>.

    Under provision 8.6 of IDEA, we are required to notify you that we experienced a security incident relating to this data:

    <insert brief description of unauthorized access and consider attaching a more detailed report>.

    Please let us know if you need any additional information to assess this incident. We are able to meet at a time of your convenience. Further, our team is reviewing this incident and identifying any remediations and future mitigation measures to prevent any future security incidents.

    Best,

    <insert Data Recipient name>

    hashtag
    Template: Data disclosure language (provision 5.11)

    Under IDEA, a Data Recipient may modify data and disclose it consistent with the signed BUCP. If disclosed, the Data Recipient must indicate that the data is modified and not original. We suggest including a footnote as follows:

    Note: Our department is not the original source of this data. We have modified this data to support our own business needs. Any inconsistency with the original data is our responsibility.

    hashtag
    Template: Notice to terminate data exchange under IDEA (provision 5.14 - rule change)

    Subject: Notice to terminate data exchange under IDEA

    CC: Agency Chief Data Officer or the Agency Information Officer

    Dear <insert Data Recipient contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.

    Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.

    Under provision 5.14 of IDEA, we are terminating this agreement due to the following statutory, regulatory, or contractual change which now prohibits our ability to share the data under our BUCP:

    <insert brief description of change and why this requires a termination and any time constraints or requirements for deletion/removal; consider attaching a more detailed report>.

    We request to meet and discuss the steps involved in this termination.

    Best,

    <insert Data Provider name>

    hashtag
    Template: Notice to terminate data exchange under IDEA (provision 5.14 - Data Recipient’s Acts)

    Subject: Notice to terminate data exchange under IDEA

    CC: Agency Chief Data Officer or the Agency Information Officer

    Dear <insert Data Recipient contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.

    Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.

    Under provision 5.14 of IDEA, we are terminating this agreement due to your act as described below:

    <insert brief description of Data Recipeint’s act that prompted this termination and why that act should lead to a termination. Describe time constraints or requirements for deletion/removal; consider attaching a more detailed report>.

    We request to meet and discuss the steps involved in this termination.

    Best,

    <insert Data Provider name>

    hashtag
    Template: Notice to terminate data exchange under IDEA (provision 7.4)

    Subject: Notice to terminate data exchange under IDEA due to cause

    CC: Statewide Chief Data Officer and Agency Chief Data Officer or the Agency Information Officer

    Dear <insert Data Recipient contact name>,

    We are both Signatory Entities under the State of California’s Interagency Data Exchange Agreement (IDEA), the umbrella memorandum of understanding that is intended to facilitate data exchange between state entities.

    Under IDEA, we negotiated a Business Use Case Proposal (BUCP), attached, in which we provided you with the following data: <insert brief description of data>.

    Under provision 7.4 of IDEA, we request to terminate this agreement as we believe you, the Data Recipient has violated a material term of our agreement:

    <insert brief description of violation and why this requires a termination and any time constraints or requirements for deletion/removal; consider attaching a more detailed report>.

    We request to meet and discuss the steps involved in this termination.

    Best,

    <insert Data Provider name>

    Frequently Asked Questions

    hashtag
    Background and When to Use

    hashtag
    What data exchange does IDEA apply to?

    IDEA applies to data that is protected by state or federal law typically due to privacy or security concerns. In short, this is data that must be assessed to ensure that exchange is allowable and secure under any prevailing statute or regulation. This typically includes personally identifiable information (PII) or highly sensitive information such as that related to security. This does not apply to data that is public or even used for internal purposes but not rising to the level of protected information. Typically, protected information is that which faces specific requirements for disclosure and allowable use or for breaches (often called notice-triggering events).

    hashtag
    Do we have to use IDEA for data exchange?

    Yes, if your department or entity is a signatory to IDEA. The goal of IDEA is to reduce administrative overhead by using the same framework for data exchange versus renegotiating the same questions. It also helps ensure that the data exchange uses consistent privacy and security practices.

    hashtag
    Are the UCs, CSUs and Community Colleges included in this effort?

    Any state entity is encouraged to and can sign onto the IDEA. As of March 2022, the UCs, CSUs, and Community Colleges have not yet done so. Please refer to the for current status.

    hashtag
    Does IDEA require us to give our data to any other state entity?

    No. Any data exchange must be allowable under governing statute and regulation. State entities retain authority to sign and allow or decline data exchange under a BUCP.

    hashtag
    Can we use this process for research-related data sharing?

    Yes, if the research requires sensitive data from another state entity that has signed the IDEA. This includes cases where the state entity is using a service provider to conduct the research on the entity’s behalf. Importantly, IDEA does not replace any existing approval processes for independent research. For example, a BUCP for research-related data from a university will need to include Institutional Review Board (IRB) approval. See the BUCP template and Section 3 of IDEA for more details. Requests for data by external researchers, either academics or institutions, for research purposes are covered by other existing processes and IDEA should not be used.

    hashtag
    We already have existing data exchange agreements. Do we need to migrate them to IDEA?

    You can leave existing agreements as is. However, any renewals or new agreements should use the BUCP process.

    hashtag
    BUCP Details

    hashtag
    Can we create a BUCP without an end date?

    Yes. While the BUCP includes a termination date, data exchanges can be ongoing or terminated by notice as long as the law allows it.

    hashtag
    We have special security and/or privacy requirements. Can we include these?

    IDEA establishes minimum security requirements by requiring that Signatory Entities meet Chapter 5300 of the State Administrative Manual. Additional security and privacy requirements can be included in the BUCP. Any additional requirements should be commensurate with risk or due to prevailing rules or regulations.

    hashtag
    Why would we ever need to de-identify data under a signed BUCP?

    You should limit data exchange to that which is necessary to meet the business need or objective. Wherever possible, data should be de-identified if individual identifiers are not necessary. For example, while the business case may require record level data, it may not require known identifiers such as name, address, or phone number. In addition, if aggregated data meets the use case aggregate data should be used. Moreover, data that has been de-identified and suppressed can be published in an open data portal.

    hashtag
    What Happens If/When

    hashtag
    What happens if the Data Recipient has a breach for data exchanged under a BUCP?

    The Data Recipient should contact the Data Provider to identify who is responsible for notification under §9.2 of IDEA. If the breach involves HIPAA-protected data held by a Covered Entity or its Business Associate, the parties must follow breach provisions in Addendum A of IDEA.

    hashtag
    How do we use the BUCP process when we need to transfer funds?

    1. Case 1: If two or more departments want to share data and transfer funds, the contractual process can run in parallel to the BUCP approval process. For example, data exchange can be addressed by the BUCP and the transfer of funds or services can be addressed by an Interagency Agreement. To avoid work duplication, attach the BUCP as an exhibit to the Interagency Agreement.

    2. Case 2: If two or more programs within the same department want to share data and transfer funds, the contractual process can also run in parallel to the BUCP approval process. For example, data exchange can be addressed by the BUCP and the transfer of funds or services can be addressed by a Memorandum of Agreement. To avoid work duplication, attach the BUCP as an exhibit to the Memorandum of Agreement.

    hashtag
    What should we do if we have a change in law or rule that affects data under a signed BUCP?

    Work with your legal and privacy team to determine if your existing BUCPs are still allowable under the rule change.

    1. If they are still allowable, update the BUCP to reflect the new legal analysis under the legal authority and refile the BUCP via the .

    2. If the data exchange is no longer permitted, see Step 8 in the guidebook on filing a notice of termination.

    hashtag
    We (the Data Recipients) received an external request for data that we received via a BUCP. How do we handle it?

    If a Data Recipient receives a request under the California Public Records Act (CPRA), a subpoena, a court order, a litigation-related request, or any other request for the data under a BUCP, under §5.18 of IDEA, immediately notify the Data Provider to meet and confer on the appropriate response.

    hashtag
    Legal

    hashtag
    Does IDEA, including data sharing with contractors, comply with § 6254.5 in the Public Records Act?

    Yes. Data that is shared consistent with the Information Practices Act, other laws covering the data, or to a governmental agency that agrees to keep the data confidential means that the data keeps its confidential status (see Government Code § 6254.5). The IDEA itself is an agreement to keep confidential data that is shared as confidential. Sharing of confidential data with other governmental agencies, contractors or business associates is permitted, and confidential information shared via IDEA will generally remain confidential and exempt from PRA. See §5.18 of IDEA and FAQ 8 for details on managing PRA requests.

    hashtag
    Does IDEA impact attorney-client or other existing privileges?

    No. Per §5.20 of IDEA, nothing in the IDEA or BUCP will diminish any privileges or protections.

    hashtag
    Results and Feedback

    hashtag
    What are the expected benefits of IDEA?

    We expect the following benefits from the IDEA:

    • Reduction in time and effort spent negotiating terms. After CHHS adopted a single agency agreement, completion time went from 2-3 years on average to 79 days.

    • Shifts bias to sharing and working together. Most data sharing negotiations are adversarial and start from a position of “no.” The IDEA starts with a commitment to data sharing and collaboration to improve services.

    • Reduction in duplication of resources and workload. The IDEA establishes the legal framework so the focus moves from creation of a legal agreement towards developing the data elements and transmission logistics. CHHS statistics show data is often transferred earlier than the projected date.

    hashtag
    What should we expect next? Can I provide feedback?

    The IDEA process is relatively new, and we want to give it time to take root. As its usage expands, we are eager to understand what is working and where there may be gaps. If you have just completed a BUCP, there is an opportunity to let us know what you think on the inventory form. At any other point you can submit feedback using . In time, based on feedback, we will determine if there is the need to revisit and update the IDEA or BUCP templates. If there are updates, they would likely only apply to future agreements.

  • Greater visibility into areas of disagreement. The IDEA establishes an escalation process for when agencies don’t agree to share that could uncover both cultural reluctance and/or legal issues that need to be addressed.

  • Ultimately, better government services through the improved sharing and use of data.

  • list of signature entities
    BUCP Inventory Formarrow-up-right
    our feedback formarrow-up-right

    List of Signatories

    This is a list of all state entities that have signed the agreement. This list is updated whenever a new signatory is added.

    Please contact usarrow-up-right if you note any errors.

    Background

    IDEA was borne out of a need to improve sharing infrastructure within the state. Learn more about its history, benefits and implementation in the material below.

    hashtag
    IDEA Briefing Deck

    This presentation introduces the IDEA process, including the background, rationale, process to develop, and scope.

    file-pdf
    3MB
    BriefingDeck-IDEA.pdf
    PDF
    arrow-up-right-from-squareOpen
    https://www.youtube.com/watch?v=hbiMrH2H_pMwww.youtube.comchevron-right