Senior Data Engineer (Azure Databricks & MLOps)
Spectraforce
US
Remote
3 days ago
Job Description
Job Title: Senior Data Engineer (Azure Databricks & MLOps)
Location: REMOTE
Duration: 06 months
Job Description: At least 5 years of experience in a relevant discipline area is required. Knowledge of the latest technologies and trends in data engineering are highly preferred and includes:
• At least 5 years of experience in data engineering with a strong background on Azure Databricks and Scala/Python.
• Experience in handling unstructured data processing and transformation with programming knowledge.
• Hands on experience in building data pipelines using Scala/Python
• Big data technologies such as Apache Spark, Structured Streaming, Advanced SQL, Databricks, Delta Lake, Azure/AWS
• Strong analytical and problem-solving skills with the ability to troubleshoot spark applications and resolve data pipeline issues.
• Familiarity with version control systems like Git, CICD pipelines.
• Experience with Azure Databricks and MLflow
• Good understanding of ML workflows, model development, and evaluation
• Knowledge of MLOps fundamentals such as CI/CD, versioning, and monitoring
• Ability to build end-to-end data and ML solutions
• Exposure to production ML or AI systems
• Understanding of data engineering and data modeling basics
• Ability to work independently on loosely defined problems
• Strong problem-solving and communication skills
• Mentoring experience is a plus
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 41.00/hr.
Location: REMOTE
Duration: 06 months
Job Description: At least 5 years of experience in a relevant discipline area is required. Knowledge of the latest technologies and trends in data engineering are highly preferred and includes:
• At least 5 years of experience in data engineering with a strong background on Azure Databricks and Scala/Python.
• Experience in handling unstructured data processing and transformation with programming knowledge.
• Hands on experience in building data pipelines using Scala/Python
• Big data technologies such as Apache Spark, Structured Streaming, Advanced SQL, Databricks, Delta Lake, Azure/AWS
• Strong analytical and problem-solving skills with the ability to troubleshoot spark applications and resolve data pipeline issues.
• Familiarity with version control systems like Git, CICD pipelines.
• Experience with Azure Databricks and MLflow
• Good understanding of ML workflows, model development, and evaluation
• Knowledge of MLOps fundamentals such as CI/CD, versioning, and monitoring
• Ability to build end-to-end data and ML solutions
• Exposure to production ML or AI systems
• Understanding of data engineering and data modeling basics
• Ability to work independently on loosely defined problems
• Strong problem-solving and communication skills
• Mentoring experience is a plus
Applicant Notices & Disclaimers
- For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 41.00/hr.