Kafka Administrator (MS Azure)
Spectraforce
Boston, Massachusetts
2 hours ago
Job Description
Job Title: Kafka Administrator (MS Azure)
Location: Remote
Duration: 04 Months
Note: Extensive System admin and Cloud engineering experience
Years of Experience: 12.00 Years of Experience
Must have hands on experience on
Cluster Management: Provisioning, configuring, and scaling Kafka clusters.
Azure Integration: Bridging Kafka with native services—e.g., configuring Azure Event Hubs (Kafka Surface) or manage data ingestion into Azure Data Lake Storage
Performance Tuning: Optimizing broker properties, partition strategies, and JVM settings to meet latency and SLAs requirements.
Security and compliance of Kafka clusters/ services
Automating the deployment of streaming infrastructure using Terraform to ensure environment parity across Dev, UAT, and Production.
Knowledge Areas:
Distributed Systems: Deep understanding of partition leadership, replication factors, ISR (In-Sync Replicas), and "exactly-once" processing semantics.
Storage Optimization: Experience managing Azure Managed Disks (Premium SSDs) for Kafka brokers to balance IOPS and cost.
Disaster Recovery: Setting up multi-region clusters using Cluster Linking or Mirror Maker 2 to ensure high availability across Azure Regions.
Troubleshooting: Ability to diagnose complex issues like "rebalance storms," consumer lag spikes, and disk pressure in a distributed environment.
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 60.00/hr.
Location: Remote
Duration: 04 Months
Note: Extensive System admin and Cloud engineering experience
Years of Experience: 12.00 Years of Experience
Must have hands on experience on
Cluster Management: Provisioning, configuring, and scaling Kafka clusters.
Azure Integration: Bridging Kafka with native services—e.g., configuring Azure Event Hubs (Kafka Surface) or manage data ingestion into Azure Data Lake Storage
Performance Tuning: Optimizing broker properties, partition strategies, and JVM settings to meet latency and SLAs requirements.
Security and compliance of Kafka clusters/ services
Automating the deployment of streaming infrastructure using Terraform to ensure environment parity across Dev, UAT, and Production.
Knowledge Areas:
Distributed Systems: Deep understanding of partition leadership, replication factors, ISR (In-Sync Replicas), and "exactly-once" processing semantics.
Storage Optimization: Experience managing Azure Managed Disks (Premium SSDs) for Kafka brokers to balance IOPS and cost.
Disaster Recovery: Setting up multi-region clusters using Cluster Linking or Mirror Maker 2 to ensure high availability across Azure Regions.
Troubleshooting: Ability to diagnose complex issues like "rebalance storms," consumer lag spikes, and disk pressure in a distributed environment.
Applicant Notices & Disclaimers
- For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 60.00/hr.