Data Platform Engineer
Spectraforce
US
3 days ago
Job Description
We are seeking a highly skilled Data Platform Engineer to join our growing team, responsible for the implementation, integration, and operational support of modern data platforms across Azure cloud infrastructure. This role requires hands-on expertise in CI/CD pipelines, AKS troubleshooting, DevOps practices, and Starburst Enterprise (SEP) administration. The ideal candidate will act as a technical bridge across internal data, infrastructure, and development teams, driving efficient platform delivery and data integration.
Key Responsibilities
• Build, maintain, and optimize CI/CD pipelines for data platform components and integrations.
• Administer and support Starburst Enterprise (SEP) environments, including:
• User/group management and Access Control Lists (ACLs) configuration.
• Performance monitoring and issue resolution.
• Troubleshooting common SEP connectivity and query issues.
• Support and troubleshoot Azure Kubernetes Service (AKS) for containerized workloads.
• Implement and manage Helm charts for AKS deployments.
• Collaborate with development, security, and data governance teams to align architecture and deployment strategies.
• Create and maintain Terraform configurations for basic infrastructure provisioning.
• Configure and analyze logs from Dynatrace and Splunk for system health monitoring and incident resolution.
• Support data integration and query connectivity across Starburst, Snowflake, Databricks, and Oracle.
• Use basic SQL commands to validate data quality, run test queries, and support ETL pipelines.
• Drive operational excellence through monitoring, incident response, and root cause analysis.
• Maintain platform documentation, including runbooks and configuration standards.
• Participate in on-call support rotations and post-incident reviews.
Required Skills and Qualifications
• 4–6 years of experience in cloud platform or DevOps engineering roles.
• Strong hands-on experience with:
• CI/CD tools such as Azure DevOps, Jenkins, or GitHub Actions.
• Azure Cloud services, especially arourage.
• Starburst Enterprise setup and maintenance.
• Helm, Terraform (basic), and Kubernetes concepts.
• Working knowledge of Dynatrace, Splunk, and infrastructure monitoring principles.
• Familiar with data integration architectures across Snowflake, Databricks, and Oracle.
• Basic understanding of SQL and ability to debug query errors and optimize joins.
We are seeking a highly skilled Data Platform Engineer to join our growing team, responsible for the implementation, integration, and operational support of modern data platforms across Azure cloud infrastructure. This role requires hands-on expertise in CI/CD pipelines, AKS troubleshooting, DevOps practices, and Starburst Enterprise (SEP) administration. The ideal candidate will act as a technical bridge across internal data, infrastructure, and development teams, driving efficient platform delivery and data integration.
Key Responsibilities
• Build, maintain, and optimize CI/CD pipelines for data platform components and integrations.
• Administer and support Starburst Enterprise (SEP) environments, including:
• User/group management and Access Control Lists (ACLs) configuration.
• Performance monitoring and issue resolution.
• Troubleshooting common SEP connectivity and query issues.
• Support and troubleshoot Azure Kubernetes Service (AKS) for containerized workloads.
• Implement and manage Helm charts for AKS deployments.
• Collaborate with development, security, and data governance teams to align architecture and deployment strategies.
• Create and maintain Terraform configurations for basic infrastructure provisioning.
• Configure and analyze logs from Dynatrace and Splunk for system health monitoring and incident resolution.
• Support data integration and query connectivity across Starburst, Snowflake, Databricks, and Oracle.
• Use basic SQL commands to validate data quality, run test queries, and support ETL pipelines.
• Drive operational excellence through monitoring, incident response, and root cause analysis.
• Maintain platform documentation, including runbooks and configuration standards.
• Participate in on-call support rotations and post-incident reviews.
Required Skills and Qualifications
• 4–6 years of experience in cloud platform or DevOps engineering roles.
• Strong hands-on experience with:
• CI/CD tools such as Azure DevOps, Jenkins, or GitHub Actions.
• Azure Cloud services, especially arourage.
• Starburst Enterprise setup and maintenance.
• Helm, Terraform (basic), and Kubernetes concepts.
• Working knowledge of Dynatrace, Splunk, and infrastructure monitoring principles.
• Familiar with data integration architectures across Snowflake, Databricks, and Oracle.
• Basic understanding of SQL and ability to debug query errors and optimize joins.