Data Engineer
8 Months
San Francisco, California(100% REMOTE)
 
Role Summary: This role supports OEIS compliance reporting by building auditable, Foundry?native data pipelines and data checker frameworks. The engineer will be responsible for compliance transformations, validation logic, and traceable outputs that meet regulatory and audit requirements.
Core Responsibilities

• Design and maintain Palantir Foundry pipelines for OEIS compliance reporting
• Build and maintain data checker / validation frameworks within Foundry
• Develop PySpark and Spark SQL transformations for large?scale datasets
• Implement compliance?driven checks (completeness, consistency, reconciliation, exception flags)
• Ensure full data lineage, auditability, and reproducibility of compliance datasets
• Partner with compliance SMEs and stakeholders to validate logic and reporting outputs
• Support operational monitoring, issue triage, and data quality remediation

Required Technical Skills

• Strong Python
• PySpark / Spark SQL
• Advanced SQL
• Hands?on experience with Palantir Foundry
• Experience building data validation, QA, or data quality frameworks
• Understanding of compliance, audit, or regulatory reporting requirements

Preferred / Nice?to?Have

• Experience with OEIS or regulatory compliance reporting
• Foundry Workshop experience
• Experience working with ontology?driven or curated datasets
• Utility, infrastructure, or asset?based domain experience

 
 
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 60.00/hr.