Senior AWS Data Engineer
Spectraforce
Newark, New Jersey
5 hours ago
Job Description
Job Title: Senior AWS Data Engineer
Location: Newark, NJ - Hybrid
Duration: 5 Months
Job Summary: Seeking for a senior AWS data engineer who can drive efficient data acquisition, curation, and delivery using services such as S3 bucket, Athena, Glue, and Cloud Formation. Collaborate with cross functional teams in a hybrid work model to enable reliable day time operations.
Required Skills: AWS Glue, AWS, AWS Cloud Formation, AWS Athena, AWS S3 bucket 5.Nice to have skills
Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code. Build reliable and robust Data ingestion pipelines within AWS, onprem to AWS ,etc. Ensure the best possible performance and quality of high scale data engineering project Participate in the architecture and system design discussions Independently perform hands on development and unit testing of the applications. Collaborate with the development team and build individual components into complex enterprise web systems. Work in a team environment with product, production operation, QE and cross functional teams to deliver a project throughout the whole software development cycle. Responsible to identify and resolve any performance issues Keep up to date with new technology development and implementation Participate in code review to make sure standards and best practices are met. Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises Programming experience with Python, Shell scripting and SQL Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc. Solid experience implementing solutions on AWS based data lakes. Should have good experience with AWS Services like API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch Serverless application development using AWS Lambda Experience in AWS data lake/data warehouse/business analytics Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS Knowledge of ETL or ELT End-to-end data solutions (ingest, storage, integration, processing, access) on AWS Architect and implement CI or CD strategy for EDP Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred) Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case AWS Solutions Architect or AWS Developer Certification preferred Good understanding of Lakehouse/data cloud architecture
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 60.00/hr.
Location: Newark, NJ - Hybrid
Duration: 5 Months
Job Summary: Seeking for a senior AWS data engineer who can drive efficient data acquisition, curation, and delivery using services such as S3 bucket, Athena, Glue, and Cloud Formation. Collaborate with cross functional teams in a hybrid work model to enable reliable day time operations.
Required Skills: AWS Glue, AWS, AWS Cloud Formation, AWS Athena, AWS S3 bucket 5.Nice to have skills
Responsibilities: Designing, building and maintaining efficient, reusable, and reliable architecture and code. Build reliable and robust Data ingestion pipelines within AWS, onprem to AWS ,etc. Ensure the best possible performance and quality of high scale data engineering project Participate in the architecture and system design discussions Independently perform hands on development and unit testing of the applications. Collaborate with the development team and build individual components into complex enterprise web systems. Work in a team environment with product, production operation, QE and cross functional teams to deliver a project throughout the whole software development cycle. Responsible to identify and resolve any performance issues Keep up to date with new technology development and implementation Participate in code review to make sure standards and best practices are met. Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises Programming experience with Python, Shell scripting and SQL Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc. Solid experience implementing solutions on AWS based data lakes. Should have good experience with AWS Services like API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch Serverless application development using AWS Lambda Experience in AWS data lake/data warehouse/business analytics Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS Knowledge of ETL or ELT End-to-end data solutions (ingest, storage, integration, processing, access) on AWS Architect and implement CI or CD strategy for EDP Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred) Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case AWS Solutions Architect or AWS Developer Certification preferred Good understanding of Lakehouse/data cloud architecture
Applicant Notices & Disclaimers
- For information on benefits, equal opportunity employment, and location-specific applicant notices, click here
At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws. This position’s starting pay is: $ 60.00/hr.