PLEASE DO NOT SHARE 3RD PARTY CANDIDATES AS CLIENT ONLY LOOKING W2 CANDIDATE.
I have Urgent job requirement for you as Senior Data Engineer - in below location. Let me know if you are interested for this.
Senior Data Engineer
15 months long
We are looking for a Senior Data Engineer, who is looking for a challenge, enjoys thinking big and looking to make their mark on an extremely fast growing company. If you have hands-on experience designing and developing streaming and IoT data pipelines this role is for you. Be part of a group who will be building large and building fast, working with a very talented team of engineers and collaborating with the brightest mind in the Automotive industry. Hands-on design and develop streaming and IoT data pipelines.Developing streaming pipeline using MQTT, Kafka, Spark Structure StreamingOrchestrate and monitor pipelines using Prometheus and KubernetesDeploy and maintain streaming jobs in CI/CD and relevant tools.Python scripting for automation and application developmentDesign and implement Apache Airflow and other dependency enforcement and scheduling tools.Hands-on data modeling and data warehousing Deploy solution using AWS, S3, Redshift and Docker/KubernetesDevelop storage and retrieval system using Presto and Parquet/ORCScripting with Apache Spark and data frame.
Bachelor or Masters in Software Engineering or Computer Science6 - 8+ years of experience in Data Engineering and Business Intelligence.Proficient in IoT tools such as MQTT, Kafka, SparkProficient with AWS, S3, RedshiftExperience with Presto and Parquet/ORCProficient with Apache Spark and data frame.Experienced in containerization, including Docker and KubernetesExpert in tools such as Apache Spark, Apache Airflow, PrestoExpert in design and implement reliable, scalable, and performant distributed systems and data pipelinesExtensive programming and software engineering experience, especially in Java, Python,Experience with Columnar database such as Redshift, VerticaGreat verbal and written communication skills.