This position will support the design and delivery of secure, scalable, and traceable data pipelines in Azure, with a focus on integrating and transforming sensitive, public-facing datasets. The candidate will build ingestion workflows and transformation logic to support reporting, analytics, and public transparency initiatives. This role requires experience with Azure-native tools, strong ETL/ELT capabilities, and a strong commitment to data quality, auditability, and responsible data use. The candidate will be working with an existing software development team in an Agile/Scrum environment.
Skill
Required / Desired
| At least 3 years of experience building and maintaining ETL/ELT pipelines in enterprise environments using Azure-native tools. | Required | 3 | Years |
| Hands-on expertise with Azure Data Factory, Dataflows, Synapse Pipelines, or similar orchestration tools. | Required | 3 | Years |
| Proficiency in SQL, Python, or PySpark for transformation logic and data cleansing workflows. | Required | 3 | Years |
| Experience with Delta Lake, Azure Data Lake Storage Gen2, JSON, and Parquet formats. | Required | 3 | Years |
| Ability to build modular, reusable pipeline components using metadata-driven approaches and robust error handling. | Required | 3 | Years |
| Familiarity with public data sources, government transparency datasets, and publishing workflows. | Required | 3 | Years |
| Knowledge of data masking, PII handling, and encryption techniques to manage sensitive data responsibly. | Required | 3 | Years |
| Experience with data quality frameworks, including automated validation, logging, and data reconciliation methods. | Required | 3 | Years |
| Strong grasp of DevOps/DataOps practices, including versioning, testing, and CI/CD for data pipelines. | Required | 3 | Years |
| Experience supporting data publishing for oversight, regulatory, or open data initiatives is highly desirable. | Required | 3 | Years |
| Certifications such as DP-203 (Azure Data Engineer Associate) or Azure Solutions Architect are a plus. | Highly desired | 3 | Years |
...best in class clinical resources for training, education, and point of care support. How you make a difference The Psychiatric Nurse Practitioner (Psych NP) follows established policies and procedures and state guidelines, ensuring compliance with supervision...
Designer Engineer (Plastics & Surfacing)Date: Apr 22, 2025Location:Pune (IND_Pune), Pune (IND_Pune), Pune (IND_Pune), Pune (IND_Workplace... ....+ Understanding of Manufacturing process FRP,Injection molding, Vacuum forming...**Your Benefits**GLOBAL DIVERSITY - Diversity...
...driving greater productivity and increasing our clients' revenue growth. Position Overview - Sales Development Representative Manager (SDR Manager): As an SDR Manager within demandDrive's Enterprise Sales Service division, you will be responsible for building,...
...Railroad Construction Foreman Build your career with an innovative and sustainable railroad maintenance and construction team! Our company is rapidly growing, and we have plenty of opportunities available for accelerated advancement. We believe that having happy and...
...General Office support: answering phones, ordering supplies and handling mail Operational Support: CRM, Custodian Platforms, Orion, DocuSign, Microsoft Systems, Betterment Platform and lead generation software. Monitoring account cash balances and systematically...