Job Title: Big Data/Machine Learning Engineer - Sr Location: Hybrid 3 day onsite _Mclean VA/ Roverwoods, IL Duration: ~7 months
Job Description: Data Engineer
Responsibilities:
Designing and implementing high-performance data pipelines that handle large volumes of data
Ensuring data integrity through advanced quality checks and lineage tracking
Required Skills & Qualifications:
Core Languages: Expert-level proficiency in Python and PySpark.
AWS Ecosystem: Deep hands-on experience with AWS Glue and Amazon EMR.
Big Data Architecture: Proven track record of building scalable pipelines for large-scale data (Terabyte-scale preferred).
Data Integrity: Demonstrated experience implementing frameworks for Data Lineage and Data Quality.
Database Knowledge: Strong experience working with S3-based lakes and relational databases (RDS/PostgreSQL/MySQL).
Preferred Experience
Industry: Experience within the Financial Services industry is a huge plus.
Real-time Processing: Experience with Kinesis or Kafka integration for low-latency data delivery.
DevOps: Familiarity with CI/CD for data pipelines and Infrastructure as Code.
Applicant Notices & Disclaimers
For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.This position's pay range is $50.00/hr - $60.00/hr.
