How Airflow helps with HIPAA audit controls for ePHI pipelines
If your organization is a covered entity or business associate running scheduled pipelines that touch electronic protected health information, Airflow can help you meet two technical requirements: the audit controls standard in 45 CFR 164.312(b) and the transmission security standard in 164.312(e)(1). Airflow does not certify HIPAA compliance, and no Security Rule standard requires certification. HHS's Office for Civil Rights judges your own documented implementation, so the work is to show how Airflow's logs, connection settings and secrets handling produce evidence you can examine. The Security Rule also splits its specifications into required and addressable ones. Audit controls is a required standard with no separate implementation specifications, so you must have a working mechanism. Transmission security has two addressable specifications, integrity controls and encryption, so you must assess whether each is reasonable and appropriate and document any alternative you choose.
Airflow covers only part of the Security Rule. A pipeline platform does not perform your enterprise risk analysis under 164.308, write your workforce sanctions and access policies, secure the data center or cloud facilities under 164.310, or replace the business associate contracts that 164.314 requires with your vendors and any party that hosts or supports the platform. Those remain your program. Before you rely on Airflow logs as audit evidence, confirm with your compliance lead which events you must record and examine, and decide where task logs, scheduler logs and the metadata database will be retained. Check whether your Airflow version and authentication setup support the audit trail you need, since Airflow 3 uses the Simple auth manager by default and the auth manager is selected through the auth_manager option.
Which HIPAA Security Rule requirements map to Airflow configuration
This table maps the Security Rule standards most relevant to Airflow to the configuration step that supports each one and the evidence an assessor will ask for. Required items must be implemented, while addressable items need a documented decision on whether the measure is reasonable and appropriate, and an equivalent measure if it is not. Read the last column first to see which decisions must be recorded before go-live.
| Requirement | Airflow configuration step | Evidence to keep | Status and decision |
|---|---|---|---|
| Audit controls, 45 CFR 164.312(b) | Enable Airflow audit logging, ship events to a central store and set retention | Exported audit events showing DAG triggers, clears and pauses by named user | Required. Confirm which events your Airflow version records. |
| Unique user identification, 164.312(a)(2)(i) | Set the auth_manager option and give each engineer and service identity its own account | Identity provider account list and role assignments with no shared logins | Required. Confirm the chosen auth manager replaces the Simple default before go-live. |
| Emergency access procedure, 164.312(a)(2)(ii) | Define a break-glass administrator path outside normal SSO, with its use logged | Written procedure, sealed credential record and a test log | Required. Test the procedure before relying on it. |
| Automatic logoff, 164.312(a)(2)(iii) | Set session lifetime and idle timeout in the auth manager or identity provider | Timeout settings export and the decision record | Addressable. Document whether the timeout is reasonable and appropriate. |
| Encryption in transit, 164.312(e)(1) and 164.312(e)(2)(ii) | Use TLS for the API server, metadata database, executor brokers and log shipping | Certificate inventory and connection tests showing encrypted sessions | Addressable. Document any connection that cannot use TLS and the alternative measure. |
| Integrity controls, 164.312(e)(2)(i) | Pin container image digests and version DAG bundles so each run maps to a reviewed commit | Deployment records with image digests and commit references per run | Addressable. Record the mechanism chosen and why it is reasonable. |
| ePHI in task logs and connections | Keep credentials in a secrets backend and confirm secret values are masked in logs | Secrets backend access policy and a log sample showing masked values | Confirm whether task logs can contain ePHI and limit who can read them. |
| Business associate terms, 164.314(a)(2)(i) | Confirm whether any hosting, support or log vendor handles ePHI and needs a contract | Signed business associate agreements and a subcontractor list | Required where a business associate handles ePHI. Confirm the position with counsel. |
What audit evidence Airflow produces and how to retain it
A HIPAA audit control under 45 CFR 164.312(b) asks for mechanisms that record and examine activity in systems that use ePHI, so the evidence has to come from several places at once. The cards below cover each evidence source Airflow produces, how to move it to a central store, and how to limit who can read the parts that may contain ePHI.
Airflow audit log records
The audit log records who performed administrative and run-level actions in Airflow, such as triggering, clearing or pausing DAGs, and when. For ePHI pipelines, this is the first record an auditor asks for when testing who could change or re-run a job that touched patient data. Check that the log entries carry a user identity that maps to your identity provider, not a shared account, and confirm that the log is written to a location the Airflow users cannot edit.
Task logs and their ePHI exposure
Task logs record what each task printed or raised, and a failing task can print rows, field values or query text that contain ePHI. Treat these logs as regulated data: they need the same access restrictions and retention rules as the source tables. Ask whether your team has tested which tasks write record-level data to stdout and whether masking or log level controls are in place before the logs leave the worker.
DAG run history and bundle commits
Run history shows each DAG run with its start and end times, state, and the trigger that started it. Pairing each run with the DAG bundle commit it executed lets you show which version of the pipeline processed a given batch of ePHI. Confirm that your deployment records the commit per run, because an auditor will ask which code was live on the date of a sampled event.
Scheduler, API server and component logs
Scheduler, DAG processor and API server logs show infrastructure events such as restarts, parsing errors, failed authentication attempts and API calls. In Airflow 3 these run as separate components, so each one needs its own log collection path. Check that every component ships logs, not only the web-facing API server, because access attempts and scheduler faults often appear in different places.
Shipping logs to a central store
Local logs on worker and scheduler hosts are lost when pods or machines are replaced, so ship them to a central store that you control. Encrypt the transport, set the retention period in your written policy, and apply write-once or access-logged storage where your platform supports it. Confirm the retention period against your own HIPAA policy and any longer state or contractual requirement, since this guide does not set one.
Sampled events with user identity
When an auditor samples an event, you need to produce the timestamp, the user or service identity, the DAG and run identifier, and the action taken, all from linked records. Build a short procedure that starts from the audit log entry and follows the run ID into the run history, the bundle commit and the task log. Test that procedure before the audit, and record who approved each sampled change so the chain of evidence is complete.
How encryption and secrets fit into a PHI-handling Airflow
Encryption for a PHI-handling Airflow has to be planned hop by hop, because Airflow does not turn it on for you. Map the data path first: connections to source systems and targets, the metadata database that stores run state, task logs written by workers, log shipping to a central store, and traffic to the API server. Each of these is a separate channel. TLS must be configured on each connection definition (for example, requiring verified certificates on the database, object storage or warehouse connection) and on each log destination, rather than assumed from the platform. Confirm for every provider you use which connection extras or parameters enable encryption and whether certificate verification is on by default. Record the answers as part of the data flow inventory your HIPAA evidence depends on.
The metadata database deserves a deliberate choice. The Airflow production guidance recommends PostgreSQL or MySQL, and the prerequisites list the supported versions and exclude MariaDB as a metadata database. SQLite must not be used in production, because the production guide warns that it can lead to data loss. Confirm that the database host enforces encrypted client connections, that storage at rest is encrypted under your key management policy, and that backups carry the same protection. Connection records and variables may hold credentials, so the database itself is part of the PHI boundary when credentials are stored there.
Credentials should live in a secrets backend that your security team already governs, not in DAG code, environment files or the metadata database. Airflow can read connections and variables from external secrets backends, and the secrets documentation for your chosen provider should be checked for rotation, access policy and audit logging before you rely on it. Masking is a second line of defense: Airflow redacts values of sensitive connection fields and variables it knows about in task logs, but it only catches values it can recognize, so a DAG that prints a patient identifier or a token built at runtime can still leak. Set a rule that task code never logs record-level PHI, and test the masking with a deliberately sensitive value in a non-production environment before you sign off.
Configuration sequence for an ePHI-processing Airflow
This sequence takes a self-hosted Airflow from prerequisites to a documented, controlled deployment where pipelines that touch ePHI have access, encryption, logging and risk decisions recorded before the first production DAG runs. Start new builds on Airflow 3, because Airflow 2 reached end of life on April 22, 2026 and gets no fixes after that date.
Confirm prerequisites and a production database
The platform engineering team checks the Airflow 3.3.2 prerequisites against the chosen Python, Kubernetes and database versions, and selects PostgreSQL 14 to 18 or MySQL 8.0, 8.4 or an Innovation release as the metadata database. MariaDB is not supported as the metadata database, and SQLite is for testing only, so it must not hold ePHI-related run history. Done means a written version matrix signed off by the platform owner and a database instance that is encrypted at rest and reachable only from Airflow components.
Separate API server, scheduler and DAG processor
The infrastructure team deploys the API server, scheduler and DAG processor as separate components, since Airflow 3 replaces the webserver with an API server and requires the DAG processor to run on its own. Each component gets its own service account, network policy and resource limits so that a fault or compromise in one does not grant access to the others. Done means each process starts independently, and a review confirms that no component shares credentials with another.
Set the auth manager and role mapping
The security team selects one auth manager through the auth_manager option, because Airflow 3 allows only one at a time and uses the Simple auth manager by default, which is not suited to a controlled ePHI environment. Roles are mapped from the identity provider so that only staff with a documented need can view, trigger or clear runs that read ePHI. Done means a test user from each role can perform only the actions their role allows, and the mapping is stored in version control.
Configure encrypted connections and secrets
The engineering team requires TLS for every connection to databases, object storage, data warehouses and log destinations, and stores credentials in a secrets backend rather than in DAG code or plain connection records. Access to each connection is limited to the DAGs that need it. Done means a scan of connection definitions finds no plaintext credentials, every endpoint negotiates TLS with certificate validation, and the secrets backend's own access logs are enabled.
Route audit and task logs to controlled storage
The operations team configures Airflow audit logs and task logs to ship to storage that the compliance and security teams control, using encrypted transport and retention periods set by the organization's policy. Read access to task logs is restricted to the same people who may view the related DAG, because task output can contain ePHI if a task prints or fails with patient data. Done means a test run produces an audit entry and task log in the controlled store, and an access test confirms that unauthorized users cannot read them.
Document the risk analysis and addressable decisions
The compliance lead records the enterprise risk analysis for the Airflow deployment and, for each addressable implementation specification in the technical safeguards, documents whether it is reasonable and appropriate, the reason for any decision not to implement it, and the equivalent measure chosen. The HIPAA audit control standard and the access and transmission security standards are the main references for this record, and NIST SP 800-66 Rev. 2 can guide the questions. Done means a signed decision record is linked to each control and reviewed by the security owner before go-live.
Verify the build before the first ePHI pipeline
The security team runs a checklist against the configuration, confirming the version matrix, component separation, role tests, TLS and secrets scan, log routing and signed decision records. Any gap is closed or formally accepted by the risk owner. Done means a dated verification record exists, and the first pipeline that processes ePHI is promoted only after that record is approved. Confirm with your own assessor which evidence they expect to sample.
What the platform does not cover for HIPAA
Does Airflow perform the HIPAA risk analysis for my pipelines?
No. Airflow is open-source software and cannot perform your risk analysis under the administrative safeguards in 45 CFR 164.308. The risk analysis must identify where ePHI is created, received, maintained or transmitted, including every DAG, connection, task log, XCom value and metadata database table that touches it, and then manage the risks you find. Your compliance or security team owns that work, with input from the engineers who write and operate the DAGs. NIST SP 800-66 Rev. 2 describes the activities in more depth and is a useful reference, though HHS treats it as informational rather than binding. Ask for the risk analysis scope in writing before any build starts, and keep it current as pipelines change.
Who trains the workforce on HIPAA for our Airflow environment?
Your organization does, and the platform cannot do it for you. The Security Rule expects workforce members who use or administer ePHI systems to be trained on security policies and procedures, and that training has to match how your team works with Airflow: who can write DAGs, who can trigger or clear runs, how secrets are handled and how suspected incidents are reported. DeployOpen can help prepare runbooks and access procedures that training can reference, but the training program, attendance records and refresher schedule remain your responsibility. Plan for training for DAG authors, operators and anyone with access to task logs.
Who is responsible for physical safeguards where Airflow is hosted?
The organization that controls the hardware, facility or cloud account carries the physical safeguards in 45 CFR 164.310. Airflow runs on servers, virtual machines or Kubernetes nodes that you or your hosting provider operate, so facility access controls, workstation and device security, and media disposal for disks that hold logs or database backups all sit outside the software. Confirm with your hosting provider which physical and environmental controls it supplies and how it documents them. Your own evidence should show who can reach the hosts and how decommissioned storage is wiped.
Do we need business associate agreements with our hosting provider and partners?
Yes, when a vendor creates, receives, maintains or transmits ePHI on your behalf. Under 45 CFR 164.314(a)(2)(i), a business associate contract must require the business associate to comply with the Security Rule, flow the same terms down to subcontractors that handle ePHI, and report security incidents to the covered entity. A cloud or colocation provider that stores Airflow metadata, logs or backups containing ePHI typically falls into this category, and so does an implementation partner that can access those systems. Ask your legal or compliance team to confirm whether each vendor's role triggers the requirement, and keep signed agreements with the evidence you collect for audits.
How does incident reporting to a covered entity work with Airflow?
Airflow logs can help you detect and investigate an incident, but the reporting obligation and the decision about what counts as a breach belong to your organization or, where you are a business associate, to the contract with the covered entity. The business associate contract must require reporting of security incidents, including breaches of unsecured PHI, so the notification path, timing and content should be defined before an event occurs. Build an incident procedure that covers DAG code changes, exposed connection credentials, unexpected task log access and metadata database compromise, and test it with the teams that would run it. Confirm the notification terms with your counsel rather than relying on any technical setting.
Does running Airflow give us HIPAA certification?
No. There is no HIPAA certification. HHS states that no Security Rule standard requires an entity to certify compliance, that it does not endorse or recognize private certifications, and that such certifications do not prevent HHS from later finding a violation (HHS FAQ 2003). Airflow is Apache-2.0 licensed open-source software with no certification of its own for HIPAA, and DeployOpen does not issue audit reports, attestations or certifications. Independent assessors may review your evidence for a third-party assurance program, but that is a separate decision. Your obligation is to meet the Security Rule and to be able to show how you did so.
Is the 2025 proposed HIPAA Security Rule revision in effect for Airflow?
Not yet. HHS proposed a major Security Rule revision on January 6, 2025 (90 FR 898, RIN 0945-AA22), with comments due March 7, 2025. As of October 2026, no final rule has been published, and the latest Unified Agenda lists the rule under Long-Term Actions with final action projected for July 2027. The current rule in 45 CFR Part 164 Subpart C still governs. Plan your Airflow controls against the current text, and review them when a final rule is published, since proposed changes could affect areas such as encryption, asset inventory and recovery planning.
Can our team build the HIPAA controls for Airflow without a partner?
Many teams can, provided they have people who understand both the Security Rule and Airflow's internals. The work includes mapping ePHI flows, configuring audit logs, encrypting connections and log shipping, restricting task log access, setting up a secrets backend, and writing the procedures and evidence that an assessor would sample. Cost and duration depend on how many pipelines touch ePHI, how many environments exist, how mature your identity and logging stack is, and whether you need outside security testing. DeployOpen plans and implements these controls under a written, fixed scope if you want a partner, and it does not issue the compliance conclusion itself. Ask any partner to state in writing which tasks it performs and which remain yours.
Where HIPAA, the HITRUST framework and NIS2 or GDPR meet this pipeline
The HIPAA Security Rule in 45 CFR Part 164 Subpart C applies to covered entities (health plans, health care clearinghouses and covered health care providers) and to their business associates, for all electronic protected health information they create, receive, maintain or transmit. For an Airflow deployment, that means any DAG that reads, transforms, stores or moves ePHI falls inside the rule, including its logs, metadata database and connections. The HHS Office for Civil Rights enforces the rule through complaint investigations, compliance reviews and audits.
- Audit controls: 45 CFR 164.312(b) requires mechanisms that record and examine activity in systems that use ePHI, so Airflow audit logs and task logs should be retained and reviewed.
- Encryption in transit: 45 CFR 164.312(e)(1) covers transmission, so connections to sources, warehouses and log destinations need encrypted channels.
- Business associate terms: a vendor or partner that runs Airflow for you must sign terms under 45 CFR 164.314(a)(2)(i), including subcontractor flow-down and incident reporting.
- Penalty exposure: for penalties assessed on or after January 28, 2026, the inflation-adjusted civil money penalty under 45 CFR 102.3 ranges from $145 to $2,190,294 per violation, with a calendar-year cap of $2,190,294.
- Pending revision: HHS proposed a major Security Rule update on January 6, 2025 (90 FR 898). Confirm its status with counsel before design sign-off.
Check whether your organization is a covered entity or business associate for each pipeline, and document the ePHI data flows that each DAG touches.
HITRUST CSF is a control framework that organizations use to structure and assess their security program, and it is often requested by customers and partners in healthcare. It is a separate assessment with its own assessor process, not a HIPAA certificate. HHS states that no Security Rule standard requires certification and does not recognize private certifications, so a HITRUST report does not replace OCR compliance obligations.
- Control structure: HITRUST CSF v11.9.0 is organized into 14 control categories, 49 control objectives and 156 control specifications.
- Assessment levels: e1 and i1 assessments are valid for one year and r2 assessments for two years, per HITRUST's published guidance.
- Mapping work: Airflow evidence (DAG review records, role assignments, log retention settings and backup results) maps to several categories, so the platform team should prepare that mapping before the assessor arrives.
- Scope boundary: define which Airflow environments, workers and metadata databases sit inside the assessed scope.
- Version choice: confirm with HITRUST which CSF version the assessor expects for your cycle.
Ask your assessor which HITRUST assessment type and version apply, and confirm that the Airflow components are included in the scope statement.
NIS2 Annex I lists health as a sector of high criticality, covering healthcare providers, EU reference laboratories, medicinal product research and development, and manufacturers of certain medical devices. GDPR Article 32 requires appropriate technical and organizational measures for personal data, including access control. The CNIL fined Hopital Prive de la Loire EUR 500,000 on September 3, 2026 under GDPR Articles 32 and 34, finding that external access to its patient record system lacked VPN and multi-factor authentication and that access control ignored the care team's need to know.
- Access control lesson: the CNIL decision shows that remote access to systems holding health data needs network controls, strong authentication and role scoping. Apply the same tests to Airflow UI, API and task log access.
- Need-to-know roles: limit which users can trigger, clear or view runs for DAGs that process patient data.
- Incident and continuity duties: NIS2 expects incident handling and continuity planning, so Airflow backups and recovery steps belong in that plan.
- Supplier obligations: if a partner operates Airflow, confirm how NIS2 supply chain requirements are handled in the contract.
- Data residency: map where logs and metadata are stored, since the European Health Data Space Regulation (EU) 2025/327 may also apply to some health data uses.
Check whether your organization falls under NIS2 Annex I and whether your Airflow access model would withstand the same questions the CNIL asked.
What buyers ask before running ePHI pipelines on Airflow
What does the implementation effort depend on for an Airflow ePHI pipeline?
The effort depends mainly on the number of DAGs, the source and destination systems they touch, where task and audit logs must go, and which identity provider staff will use. Each DAG that reads or writes ePHI needs its data flow mapped, its connections reviewed for encryption in transit, and its logs classified. Source systems multiply the work because each one needs its own connection, credentials and access rule. Log destinations matter because audit evidence must be shipped and retained outside the scheduler. The identity provider sets how role mapping and access reviews are built. Ask any partner to size the work against these four drivers in a written scope before agreeing a price or timeline.
Can an internal team run a HIPAA-scoped Airflow alone?
Yes, an internal team can run it alone if it has the skills and time, but the skills need to cover more than Airflow itself. The team needs people who can operate the scheduler, metadata database, executors and secrets backend, people who can review DAG code for ePHI handling, and someone who can read the HIPAA Security Rule controls for audit logging, access and transmission security. Most teams find the gap in access reviews, log retention and documented risk decisions rather than in the scheduler. A useful test is whether your team can show, for a sample pipeline, who changed it, who ran it, where its logs went and how the encryption was verified. If any of those answers depend on one person, the work is not yet ready to hand to auditors.
What does a partner need from our organization to start?
A partner needs three things before design work can start. First, your architecture decisions: which executor, where the metadata database runs, how DAGs are delivered and where logs are stored. Second, access to the systems involved, including the cloud or data center accounts, source databases, identity provider and any existing log platform, granted under your own change process. Third, a named risk owner who can accept or reject residual risk on your behalf and sign off on documented exceptions for addressable implementation specifications. Without that person, technical decisions stall at the first compliance question. Your compliance or privacy lead should also confirm which pipelines actually carry ePHI, because the scope of the work follows from that list.
Is there an official HIPAA certification for our Airflow platform?
No. There is no HIPAA certification. HHS states that no Security Rule standard requires an entity to certify compliance, and that HHS does not endorse or recognize private certifications. Those certifications also do not prevent HHS from later finding a violation. Covered entities and business associates must comply with the Security Rule in 45 CFR Part 164 Subpart C, and the Office for Civil Rights checks compliance through complaints, compliance reviews and audits. Vendors and consultants who offer a HIPAA certificate for a platform are describing a third-party assessment or attestation, which is a different thing. Ask any provider to name exactly what was tested, by whom, against which criteria and for what period. DeployOpen prepares systems, controls and evidence for compliance assessments, but does not issue audit reports, attestations or certifications.
How are HIPAA civil money penalties calculated under 45 CFR 102.3?
Penalties are set per violation within tiers based on the level of culpability, and each tier has an annual calendar-year cap. For penalties assessed on or after January 28, 2026, the inflation-adjusted amount under 45 CFR 102.3 (published at 91 FR 3666) ranges from $145 per violation where the entity did not know of the violation, up to $2,190,294 per violation for uncorrected willful neglect. The calendar-year cap for identical provisions is also $2,190,294. The number of violations, the tier, whether the problem was corrected, and the entity's own documented efforts all shape the outcome. Because penalties apply per violation, weak logging or access controls across many pipelines can add up quickly. Confirm the current figures against the eCFR text before relying on them, since they are adjusted for inflation.
How do we ask for a fixed-scope quote for an Airflow ePHI build?
Ask for a quote that follows from a written scope, not a rate card. DeployOpen does not publish a price list, and most engagements are fixed-scope, with scope, deliverables and timelines agreed in writing before work starts. Give the partner your DAG inventory with ePHI flags, the source and destination systems, the executor and deployment target, the identity provider, the log destinations and your retention rules. Ask the quote to separate one-time build work from recurring items such as upgrades, patching, access reviews and evidence collection. Ask which items are excluded, who provides the infrastructure and licenses, and what happens if the inventory changes during the build. Ongoing support, upgrades and continuous testing are available as retainers, so ask for those as separate lines.
Which Airflow log and access controls should we confirm first?
Confirm four things first. Confirm that audit logs from Airflow capture who triggered, cleared or changed runs and DAGs, and that they are shipped off the scheduler to a store you control. Confirm that task logs, which can contain ePHI in output or error messages, have restricted read access that matches your need-to-know rules. Confirm that connections to databases, object storage and log platforms use encrypted transport, and that the settings are verified in your environment rather than assumed from defaults. Confirm where secrets are stored and who can read them. Airflow 3 uses the Simple auth manager by default, so an identity integration and role model should be planned before production use. Check the current Airflow production guide and your own configuration to verify each point, as the exact options depend on your version and providers.
How DeployOpen works on this
DeployOpen plans, builds, documents and supports self-hosted Apache Airflow inside infrastructure you control, including the pipelines that move ePHI. We start from the data flows and the Security Rule safeguards they touch, then agree the work in a written, fixed-scope plan before any configuration begins.
How we scope
- Map which DAGs, connections and task logs touch ePHI, and where each one is stored and transmitted.
- Agree in writing which audit logging, encryption, access and secrets controls the engagement covers.
- Confirm with your compliance and privacy leads which HIPAA safeguards are yours to evidence and which sit with your business associates.
How we build
- Configure the metadata database, scheduler, API server and DAG processor on the platform you choose, using Airflow 3 components.
- Set up encrypted connections, log shipping and secrets backends, then test that credentials and ePHI stay out of logs.
- Restrict task log access and audit log retention to named roles, and test those roles against real run histories in staging.
How we hand over
- Deliver a written configuration record covering audit controls, encryption settings, access roles and secrets handling.
- Document the change process for DAGs and upgrades, and the steps your team follows to review and promote changes.
- Run a handover session so your engineers can operate, verify and extend the controls without relying on us.
How we support
- Offer ongoing support, upgrades and continuous testing as a retainer, scoped separately from the initial build.
- Review Airflow version changes and security fixes against the configuration we delivered, and confirm the upgrade path with you.
- Keep evidence current for your assessors, noting that independent auditors, not DeployOpen, decide whether your controls meet HIPAA.

