Senior ETL Hadoop Developer Job at Cloud Analytics Technologies LLC, California

Yy92dHo0bFdEdXB5Vit4WHcya0RJK1prNkE9PQ==
  • Cloud Analytics Technologies LLC
  • California

Job Description

Job Description 

Description:

Position requires resource to work with business team to understand data requirements and work with source systems
Requires extracting data from source systems and loading into Hadoop(Spark)
Requires investing and resolving data and system issues, provide support

Proven experience in Designing & building data lake on Hadoop using latest technologies
Experience in building integration layer to integrate data from multiple systems to Hadoop
Experience in Architecture and solution design of analytics on Hadoop
Experience in building pipeline to ingest data into Hadoop
Working experience in dealing with data in multiple formats (csv, txt, xml, JSON)
10 Years of experience in building DW/ETL applications
5+ Years of experience in working with Hadoop echo system
Working experience with Hive, Spark, Python, Hadoop libraries
Experience in building data lake in Hadoop is must
Experience in building ETL and data aggregations
Experience with sqoop/ flumes/ spark is required
Excellent SQL knowledge is required
Experience in working in extracting data from RDBMS, SAS applications using API's

Must have skills 

10+ yrs experience in building DW/ETL applications / 5+ yrs experience in working with Hadoop echo system / Knowledge of Hive, Spark, Python, Hadoop libraries / experience building data lake in Hadoop / Experience with sqoop, flumes, spark / Excellent SQL knowledge

Nice to have skills 

Visualization skills, Power BI experience.experience

Roles and responsibilities 

Working with source systems to design, then developing ETL to load data. Troubleshoot issues and collaborating with support system partners to troubleshoot issues. See JD

Job Tags

Work experience placement,

Similar Jobs

Guardian Proservices

Baggage Handler ( RSW Airport) Job at Guardian Proservices

 ...provide safe and courteous baggage handling services to various airline passengers. Making Every Moment Matter for a World on the GO ,...  ...Must be at least 18 years of age Be authorized to work in the United States Must be able to clear a background verification.... 

JUICE

Digital Marketing Account Manager Job at JUICE

 ...Overview The Client Success Manager is a pivotal role within...  ...clients and our diverse team of marketing specialists. You will...  ...channels will enable you to influence strategies effectively, ensuring...  ...enhance team productivity and accountability through meticulous project tracking... 

Vkore Solutions

Python Developer (FULL TIME) Job at Vkore Solutions

 ...Role: Senior Python Developer Location: REMOTE Mode of Hire: Full Time Experience in implementing server-side technologies with RESTful APIs and MVC/MVT design patterns using Django/Flask frameworks. Experienced in MVW frameworks like Django... 

Stony Brook University

Pediatric Cardiologist, Assistant/Associate Professor, Pediatrics, Cardiology | Stony Brook University Job at Stony Brook University

 ...to applicants with experience in research and graduate medical education. Responsibilities and Requirements : As an academic...  ...encouraged. The medical school environment and prestigious Health Sciences Center provide an excellent opportunity for Clinical and... 

Compass Group

BARISTA (FULL TIME) Job at Compass Group

 ...We are hiring immediatelyfor a full time BARISTA position. Location : Freddie Mac - 1550 West Branch Drive, Mc Lean, VA 2...  ...hours may vary. More details upon interview. Requirement :No experience is necessary. Willing to train!*Internal Employee Referral Bonus...