Senior/Lead Data Engineer (ADB)
USD 131K-174K (estimate) Senior-level Full Time
Tasks
- Build scalable data pipelines
- Collaborate with cross-functional teams
- Communicate with client
- Conduct code reviews
- Define coding standards
- Develop PySpark workflows
- Develop and maintain Spark applications
- Maintain documentation
- Migrate SQL to Spark SQL
- Optimize spark performance
- Process and transform data
- Troubleshoot technical issues
Perks/Benefits
- Hybrid/Remote flexibility
- Medical healthcare
- Ongoing learning reimbursement
- Referral bonuses
- Sports compensation
- Team events
- Top tier equipment provision
- Well-being program
Skills/Tech-stack
.Net 8 | ASP.Net Core | Angular | Apache Spark | Azure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Lake | Azure Data Lake Storage | Azure SQL | Azure Service | Azure Service Bus | Blob Storage | Data Lake Storage | Databricks | Delta Lake | Delta Tables | Docker | GitHub Copilot | GitHub Enterprise | Kendo UI | Kubernetes | Langchain | Langgraph | Microservices | MongoDB | Pandas | Parquet | Polars | PySpark | Python | Retrieval-Augmented Generation | SQL | Service Bus | Spark SQL
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Senior Data Engineer
Related jobs
-
Data Visualization Engineer - Advanced Engineering USD 86K-106KAccess Control | Change Management | Client-Server | Cybersecurity | Data GovernanceMid-level Full TimeHeath, OH, United States3h ago
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Apache Airflow | Apache Spark | Azure | Cloud ComposerSenior-level Full TimeSan Mateo, CA, United States R4h ago
-
Lead AI Engineer-Machine Learning USD 100K-115KAWS | Agile | Azure | CI/CD | Computer Vision401k match | Dental insurance | Disability insurance | Growth opportunities | HolidaysSenior-level Full TimeParsippany, NJ, United States5h ago
-
Senior Embedded Software Engineer USD 125K-160KAMD Xilinx | ARM Cortex | C# | Digital Signal | Digital Signal Processing401k match | Dental insurance | Employee assistance program | Every other Friday off | HSA/FSASenior-level Full TimeCamarillo, CA, United States5h ago
-
Application Security | Automation | Azure | Azure Data | Azure Data ExplorerRemote work opportunityMid-level Full TimeBulgaria R5h ago
-
Automation | Azure Data | Azure Data Explorer | CSV | ComplianceCross-functional collaboration | Exposure to large scale security telemetry | Opportunity to contribute to threat detection incident response and compliance | Professional growth | Remote work opportunityMid-level Full TimePoland R5h ago
-
Automation | Azure | Azure Data | Azure Data Explorer | CSVCross-functional collaboration | Exposure to infrastructure as code and automation | Professional growth | Remote work | Work on large scale security telemetryMid-level Full TimeRomania R5h ago
-
Mechanical Robotics Engineer USD 99K-149KAutoCAD | Cause analysis | Condition Monitoring | Current Signature Analysis | DeviceNet401k company match | Health care benefits | Paid Holidays | Paid sick leave | Paid vacationMid-level Full TimeLincolnton, NC, United States5h ago
-
Data Engineer Stf - E4 USD 131K-243KAccess Control | Apache NiFi | Apache Spark | Data Modeling | Data Processing401k match | Dental insurance | Education assistance | Employee assistance program | Flexible spending accountsSenior-level Full TimeFort Worth, TX, US6h ago
-
Technology Specialist - Databricks, Azure PLN 276K-276KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Hybrid workMid-level Full TimeKraków, PL6h ago
-
Enterprise Analytics Lead USD 119K-222KABAP | Access Control | Analysis Services | Analytics Cloud | Azure SynapseExtra day off every other week | Flexible 9/80 schedule | In office with flexible scheduleSenior-level Full TimePortsmouth, NH, United States7h ago
-
Data Engineer USD 126K-208KAPI Integration | AWS | Airflow | Azure | BigQueryDEI initiatives | Dental insurance | Employee rewards and recognition | Medical insurance | Mental health supportMid-level Full TimeRemote, United States7h ago
-
Data Analytics Engineer USD 126K-208KAmazon Web Services | Azure Data | Azure Data Factory | Azure Data Lake | Cloud platformDEI initiatives | Mental health support | Retirement plans | Rewards and recognition | Sustainability initiativesSenior-level Full TimeRemote, United States7h ago
-
Data Analytics & Engineering Opportunities USD 65K-105KHive | Microstrategy | MySQL | Oracle | Python401K Profit Share | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States7h ago
-
AWS | Amazon Web Services | Argo CD | Docker | ElasticsearchFlexible work schedule | Referral bonusesMid-levelLaurel, Maryland9h ago
-
AI Agents | Data Pipelines | Docker | Elasticsearch | KubernetesFlexible work schedule | Referral bonusesSenior-levelColumbia, Maryland9h ago
-
Computer Scientist II USD 85K-100KAgile | Angular | Azure DevOps | C Sharp | CI/CD401k match | Dental insurance | Disability insurance | Health savings account | Life insuranceMid-level Full TimeLas Vegas, NV, United States9h ago
-
Computer Scientist V - Senior Software Systems Engineer USD 140K-190KAgile | Artificial Intelligence | C# | C++ | Cloud Computing401k match | Disability insurance | Health benefits on day 1 | Health savings account | Life insuranceSenior-level Full TimeEdwards AFB, CA, United States9h ago
-
Entry-level Full TimeLas Vegas, NV, United States9h ago
-
AI Architect Lead (Hybrid-within BankUnited's footprint) USD 148K-205KAI Foundry | AWS | AWS Bedrock | Artificial Intelligence | AutogenSenior-level Full TimeMiami Lakes, FL, United States9h ago
-
Data Analytics Engineer USD 98K-124KAWS | AWS Glue | Adobe Analytics | Amazon Athena | Amazon CloudWatchMid-level Full TimeMiami Lakes, FL, United States9h ago
-
Cloud Data Engineer II USD 107K-150KAPI Integration | AWS | AWS Glue | AWS Step Functions | Apache AirflowMid-level Full TimeMiami Lakes, FL, United States9h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R10h ago
-
Biometrics | C++ | Computer Vision | Machine Learning | Multimodal LearningOffice three days per week | Relocation assistanceMid-level Full TimeSan Francisco R10h ago
-
Software Engineer - Backend Platform USD 140K-205KAPI Design | AWS | Cloud platform | Databases | Distributed SystemsComprehensive health coverage | Coworking stipend | Equity | Flexible savings accounts | Remote workMid-level Full TimePalo Alto, California, United States R11h ago