Azure Data Lead
Jersey City, NJ, United States
USD 130K-150K (estimate) Senior-level Full Time
Tasks
- Build batch and near real time ingestion
- Configure ADLS Gen2 storage access control and lifecycle
- Create data lake and warehouse integration
- Design scalable Azure data pipelines
- Develop Azure Data Factory pipelines
- Develop PySpark ETL ELT jobs
- Implement CI/CD and deployment automation
- Implement data transformation and data validation
- Model and integrate Cosmos DB data
- Monitor pipeline health and handle failures
- Optimize Spark transformations
- Perform data quality controls and audit logging
- Resolve production data pipeline incidents
- Tune Synapse SQL workloads and performance
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Synapse | Azure Synapse Analytics | CI/CD | Cosmos DB | Data Factory | Data Lake Storage Gen2 | Delta Lake | Git | Microsoft Azure | PySpark | Python | SQL | Synapse Analytics
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Platform Software Engineer USD 125K-194KCI/CD | Cloud Computing | Data Lakes | Data Modeling | Data Structures401k match | ESPP | Family leave programs | Flexible time off | Health plansEntry-level Full TimeSan Diego, CALIFORNIA, United States R4h ago
-
Data Engineer USD 150K-160KApache Iceberg | Cloud Data | Cloud Data Warehouses | Data Lakes | Data Warehouses401k | Employee assistance program | Health spending account | Life insurance | Long-term disabilityMid-level ContractSunnyvale, California, USA R5h ago
-
Apache Iceberg | Apache Spark | Avro | Concurrency | Data Ingestion401k matching | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeSan Diego, CALIFORNIA, United States R6h ago
-
API | AWS | Automated testing | Cloud Computing | Code generation401k | Dental insurance | Discounts and perks | Fully remote | Medical insuranceSenior-level Full TimeUniversal City, CALIFORNIA, United States R7h ago
-
Lead GenAI Engineer USD 150K-170KAgile | Azure | Cloud platform | Containerization | Cybersecurity401k | Employee assistance program | Health savings account | Life insurance | Long-term disabilitySenior-level ContractMinneapolis, Minnesota, USA R8h ago
-
API Development | Agent systems | BigQuery | Data integration | Databricks401k matching | Cell phone stipend | College Savings Assistance | Counseling services | Dental insuranceSenior-level Full TimeNew York, NY, United States9h ago
-
AI Model Engineer USD 125K-150KAWS Glue | Agentic Workflow | Apache Airflow | Apache Spark | BashHybrid Remote Onsite | Public Trust requiredSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Senior-level Full TimeRemote, USA, United States R12h ago
-
Software Engineer 1 - (Python, PySpark, AWS) USD 164K-201KAWS Glue | AWS Lambda | Amazon DynamoDB | PySpark | Python401k match | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offSenior-level Full TimeAnnapolis Junction, Maryland12h ago
-
Enterprise - Software Engineer - Python, PySpark, AWS USD 185K-200KAWS Glue | AWS Lambda | Amazon DynamoDB | Amazon Web Services | PySparkBirthday off | Company events | Dental coverage | Flexible work schedule | Group life insuranceSenior-level Full TimeAnnapolis Junction, MD R12h ago
-
Agent systems | Agentic Workflows | Amazon Web Services | Azure | C#Customer site travel | Remote workSenior-level Contract Full TimeJersey City, NJ, United States R13h ago
-
Artificial Intelligence | C plus plus | C# | Embedded Systems | Firmware DevelopmentEntry-level Full TimeMoon Township, Pennsylvania, USA, 1510813h ago
-
Lead AI Engineer USD 125K-180KAPIs | AWS | AWS Bedrock | Agentic Workflows | Azure401k | Commuter benefits | Dental insurance | Disability coverage | Employee assistance programSenior-level Full TimeColumbia, MD, United States13h ago
-
Data Engineer, Transplant/DOS USD 75K-102KAgile | Azure Data | Azure Data Factory | Change Data Capture | Crystal Reports401k matching | Loan forgiveness | Tuition reimbursementMid-level Full TimeChicago, IL, United States14h ago
-
Eagle Developer USD 148K-166KAgile | C# | Data Integrator | Database Programming | Development Life CycleSenior-level Full TimePittsburgh, United States14h ago
-
Agile | Angular | Azure DevOps | CSS | Cloud DataHybrid RemoteMid-level Full TimeTampa R14h ago
-
AI Architect & RAG Data Science Engineer USD 147K-206KAccess Management | Azure | Azure DevOps | BM25 | C#Onsite collaboration | Security clearance support | Telework optionsSenior-level Full TimeHuntsville, AL, USA14h ago
-
Data Solutions Engineer USD 95K-120KData Governance | Data Lakes | Data Modeling | Data Pipelines | Data Quality401k company match | Continuous training | Health plan | Mentoring opportunities | Paid HolidaysMid-level Full TimeMaple Shade, NJ, United States15h ago
-
Staff Officer (Data Science) USD 128K-128KData Preprocessing | Data Visualization | Data integration | Deep learning | Feature EngineeringSenior-level Full TimeUnited States of America-Norfolk15h ago
-
Deep learning | Entity recognition | Flink | Graph Embedding | HadoopEntry-level InternshipSeattle, Washington, United States16h ago
-
Apache Spark | Deep learning | Entity recognition | Flink | Graph EmbeddingCommunity building events | Industry expert collaboration | Professional development eventsEntry-level InternshipSan Jose, California, United States16h ago
-
BERT | C++ | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States16h ago
-
C++ | Computer Vision | Deep learning | Distributed Training | Domain AdaptationMid-level Full TimeSan Jose, California, United States16h ago
-
Entry-level Full TimeSan Jose, California, United States16h ago
-
C# | C++ | Data Structures | Deep learning | PyTorchEntry-level Full TimeSan Jose, California, United States16h ago