Job Summary: Data Engineer as an experienced data architect designing and optimizing cloud data solutions that use Azure Databricks and Snowflake SQL to deliver trusted analytics for business stakeholders in a hybrid work environment. Collaborate with cross functional teams to create scalable data models and pipelines on Azure that enhance data driven decision making and support sustainable growth for the organization and society.
Design robust end to end data architectures on Azure that integrate Azure Databricks and Snowflake SQL to deliver scalable analytical platforms supporting complex business reporting and advanced analytics needs for global stakeholders.
Develop and refine enterprise data models on Azure that align with business domains ensuring consistent definitions optimized schemas and reliable data relationships that enable efficient querying and insight generation.
Create optimized data ingestion and transformation pipelines using Azure Databricks that process structured and semi structured data with strong code quality practices improving data accuracy timeliness and usability.
Implement efficient data warehousing structures in Snowflake using advanced SQL techniques to support flexible self service analytics faster query performance and reduced data duplication across teams.
Collaborate with product owners business analysts and data scientists to translate analytical and reporting requirements into target data architecture designs that maximize usability and minimize technical debt.
Establish and enforce data governance practices including data quality rules metadata standards and access controls that ensure compliant handling of sensitive information and trustworthy analytics outcomes.
Provide technical guidance on Azure services such as Azure Data Lake Azure Data Factory and related components to design integrated cloud data solutions that are secure cost efficient and resilient.
Optimize Azure Databricks workloads through careful cluster configuration efficient code patterns and resource monitoring resulting in predictable performance and improved platform reliability for day operations.
Drive continuous improvement of existing data platforms by analyzing performance bottlenecks refactoring legacy logic and proposing modernization initiatives that increase automation and reduce manual data handling.
Document data architecture patterns data flows and design decisions in a clear reusable manner so engineering and analytics teams can easily adopt and extend the solutions across projects.
Coordinate with security and compliance teams to embed privacy controls encryption strategies and access policies within the data architecture ensuring adherence to organizational and regulatory expectations
Support incident resolution and root cause analysis for data issues by troubleshooting Azure Databricks jobs and Snowflake SQL queries thereby maintaining stable day shift operations without travel requirements.
Guide peers on best practices for data modeling coding standards and testing approaches so project teams can consistently deliver high quality data solutions that contribute to better societal and business outcomes.?
Qualifications
Possess seven to ten years of professional experience in data engineering or data architecture roles demonstrating ownership of complex cloud data solutions in large multinational environments.
Exhibit deep hands on expertise in Azure Databricks including notebook development job orchestration and performance tuning for large scale data processing workloads.
Show strong proficiency in Snowflake SQL with experience in designing schemas writing complex queries implementing optimization strategies and managing data sharing capabilities.
Demonstrate solid understanding of Azure data ecosystem including Azure Data Lake Azure Data Factory and related services to design cohesive and maintainable data platforms.
Apply advanced knowledge of data modeling techniques such as dimensional modeling normalized structures and modern analytics oriented patterns to support reliable business intelligence
Use strong analytical and problem solving skills to diagnose data quality issues performance gaps and design constraints then propose practical solutions that enhance platform effectiveness.
Communicate clearly with technical and nontechnical partners providing concise explanations of data designs and risks so decisions can be made efficiently and inclusively.
Adapt effectively within a hybrid work model managing collaboration across onsite and remote team members while maintaining high quality deliverables during regular day shifts.
? Value ethical data usage and sustainability considerations ensuring that data solutions support responsible decision making and positive societal impact in line with organizational values.
Years of Experience: 10.00 Years of Experience
Applicant Notices & Disclaimers
For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.This position's pay range is $50.00/hr - $53.57/hr.
