Job Summary: As a Cloud Data Engineer, you will play a crucial role in Clients Technologies’ organization, in processing and analyzing IoT data from our connected products to drive value for our customers. You will be responsible for delivering analytical data solutions for both internal and external customers. The Cloud Data Engineer plays an active role in designing, developing, deploying, and monitoring data pipelines as part of our connected product solution. The ideal candidate will have a strong background in data pipelines, data warehouses, data streaming, data quality, databases, and other business intelligence patterns and tooling.
Responsibilities:
Develop and implement strategies for processing and analyzing large volumes of IoT data, ensuring scalability and performance.
Design, develop, and maintain streaming and batch data pipelines in our AWS cloud environment
Participate in the planning and prioritization of development tasks, ensuring efficient use of resources and timely delivery of projects
Collaborate with data analysts and data scientists to understand their data requirements and develop solutions to meet their needs.
Optimize and tune data pipelines for performance and scalability.
Develop and maintain monitoring and alerting solutions to ensure data quality and availability.
Collaborate with our Platform team to ensure data analytics infrastructure is secure, reliable, and highly available.
Continuously research and evaluate new tools and technologies to improve data processing and analytics capabilities.
Conduct code reviews to ensure adherence to coding standards and best practices.
Capture and document data lineage, metadata, and data dictionaries to ensure comprehensive data governance.
Key Competencies:
Advanced knowledge of cloud technologies and services, specifically around Amazon Web Services (AWS) Data Analytics tools (ex: Glue, Redshift, Lambda, Kinesis)
Broad understanding of data engineering methodologies and tools, including data warehousing, DevOps/DataOps, data ingestion, ELT/ETL, and data visualization tools
Knowledge of database management systems, data modeling, and data warehousing best practices
Strong coding skills in languages such as Pyspark, Scala, and SQL
Experience in data streaming technologies such as Kafka, Kinesis, or Pub/Sub
Experience in handling unstructured streaming data is highly desired
Experience in software development on a team using Agile methodology
Knowledge of Business Intelligence Dimensional Modelling, Star Schemas, Slowly Changing Dimensions
Knowledge of DevOps tools and techniques (Ex: CI/CD, Azure DevOps, etc.)
Knowledge of data governance and security practices
Qualifications:
Bachelor’s degree in computer science, Information Technology, or a related field.
8+ years’ experience with cloud data and analytics platforms such as AWS, Azure, or GCP
5+ years of experience working with data & analytics concepts such as SQL, ETL, ELT, reporting and report building, data visualization, data lineage, data importing & exporting, and data warehousing
3+ years of experience working with general IT concepts such as integrations, encryption, authentication & authorization, batch processing, real-time processing, CI/CD, automation
About Us: Established in 2004, SPECTRAFORCE® is one of the largest and fastest-growing diversity-owned staffing firms in the US. The growth of our company is a direct result of our global client service delivery model that is powered by our state-of-the-art A.I. proprietary talent acquisition platform, robust ISO 9001:2015/ISO 27001 certified processes, and strong and passionate client engaged teams. We have built our business by providing talent and project-based solutions, including Contingent, Permanent, and Statement of Work (SOW) services to over 140 clients in the US, Canada, Puerto Rico, Costa Rica, and India. Key industries that we service include Technology, Financial Services, Life Sciences, Healthcare, Telecom, Retail, Utilities and Transportation. SPECTRAFORCE is built on a concept of “human connection,” defined by our branding attitude of NEWJOBPHORIA®, which is the excitement of bringing joy and freedom to the work lifestyle so our people and clients can reach their highest potential. Learn more at: http://www.spectraforce.com
Benefits: SPECTRAFORCE offers ACA compliant health benefits as well as dental, vision, accident, critical illness, voluntary life, and hospital indemnity insurances to eligible employees. Additional benefits offered to eligible employees include commuter benefits, 401K plan with matching, and a referral bonus program. SPECTRAFORCE provides unpaid leave as well as paid sick leave when required by law.
Equal Opportunity Employer: SPECTRAFORCE is an equal opportunity employer and does not discriminate against any employee or applicant for employment because of race, religion, color, sex, national origin, age, sexual orientation, gender identity, genetic information, disability or veteran status, or any other category protected by applicable federal, state, or local laws. Please contact Human Resources at LOA@spectraforce.com if you require reasonable accommodation.
California Applicant Notice: SPECTRAFORCE is committed to complying with the California Privacy Rights Act (“CPRA”) effective January 1, 2023; and all data privacy laws in the jurisdictions in which it recruits and hires employees. A Notice to California Job Applicants Regarding the Collection of Personal Information can be located on our website. Applicants with disabilities may access this notice in an alternative format by contacting NAHR@spectraforce.com.
LA County, CA Applicant Notice: If you are selected for this position with SPECTRAFORCE, your offer is contingent upon the satisfactory completion of several requirements, including but not limited to, a criminal background check. We consider qualified applicants with arrest or conviction records for employment in accordance with all local ordinances and state laws, including the Los Angeles County Fair Chance Ordinance for Employers (FCO) and the California Fair Chance Act (FCA). The background check assessment will consider whether a criminal history could reasonably have a direct, adverse impact on the job-related safety, security, trust, regulatory compliance, or suitability for this role. Such findings may result in withdrawal of a conditional job offer.
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $58.00/hr.
