Senior Data Engineer (W2 Only)

Fastnet Software International Inc.
Published
September 8, 2021
Location
Newark, CA
Category
Job Type

Description

PLEASE DO NOT SHARE 3RD PARTY CANDIDATES AS CLIENT ONLY LOOKING W2 CANDIDATE.

NO C2C

Hi,

I have Urgent job requirement for you as Senior Data Engineer - in below location. Let me know if you are interested for this.

Senior Data Engineer

Newark CA

15 months long

We are looking for a Senior Data Engineer, who is looking for a challenge, enjoys thinking big and looking to make their mark on an extremely fast growing company. If you have hands-on experience designing and developing streaming and IoT data pipelines this role is for you. Be part of a group who will be building large and building fast, working with a very talented team of engineers and collaborating with the brightest mind in the Automotive industry. Hands-on design and develop streaming and IoT data pipelines.Developing streaming pipeline using MQTT, Kafka, Spark Structure StreamingOrchestrate and monitor pipelines using Prometheus and KubernetesDeploy and maintain streaming jobs in CI/CD and relevant tools.Python scripting for automation and application developmentDesign and implement Apache Airflow and other dependency enforcement and scheduling tools.Hands-on data modeling and data warehousing Deploy solution using AWS, S3, Redshift and Docker/KubernetesDevelop storage and retrieval system using Presto and Parquet/ORCScripting with Apache Spark and data frame.

Requirements

Bachelor or Masters in Software Engineering or Computer Science6 - 8+ years of experience in Data Engineering and Business Intelligence.Proficient in IoT tools such as MQTT, Kafka, SparkProficient with AWS, S3, RedshiftExperience with Presto and Parquet/ORCProficient with Apache Spark and data frame.Experienced in containerization, including Docker and KubernetesExpert in tools such as Apache Spark, Apache Airflow, PrestoExpert in design and implement reliable, scalable, and performant distributed systems and data pipelinesExtensive programming and software engineering experience, especially in Java, Python,Experience with Columnar database such as Redshift, VerticaGreat verbal and written communication skills.

Apply
Drop files here browse files ...

Related Jobs

Synthetic Data Producer   Cupertino, CA new
September 22, 2021
LVN- San Francisco/ Morgan Hill CA.   Morgan Hill, CA new
September 22, 2021
Flu Clinic- RN/LVN/MA   Stanford, CA new
September 22, 2021
Nurse Manager of Community Clinic   Union City, CA new
September 22, 2021

Author: