Data Engineer
Tasks
- Architect data integration pipelines
- Build data storage warehouses data lakes and data lakehouses
- Create and optimize Apache Spark jobs and clusters
- Design data models and schemas for analytics
- Develop Python and PySpark data pipelines
- Develop and maintain ELT/ETL processes
- Implement automated testing and performance testing
- Implement data orchestration workflows
- Mentor junior engineers
- Migrate Azure Synapse to Azure Data Lake
Perks/Benefits
Skills/Tech-stack
ARM | Agile | Airflow | Apache Spark | Azure | Azure Artifacts | Azure Blob | Azure Blob Storage | Azure Boards | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Pipelines | Azure SQL | Azure SQL Database | Azure Stream | Azure Stream Analytics | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | DBT | Data Factory | Data Governance | Data Lake | Data Modeling | Data Quality | Data Warehousing | Databricks | Databricks Workflows | Delta Lake | Delta Sharing | ELT | ETL | GitHub | GitHub Actions | Infrastructure as Code | Jenkins | Jira | Kafka | NumPy | Pandas | PySpark | Python | SDLC | SQL | SQL Database | Scala | Spark SQL | Stream Analytics | Synapse Analytics | Terraform | Unity Catalog | “as-code”
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Data Engineer II USD 145K-165KAWS | Agile | Apache Airflow | Apache Spark | CI/CD401k match | Company-provided phone | Extended leave | Generous PTO | Health insuranceMid-level Full TimeNew York, New York, United States12h ago
-
API | AWS Glue | Amazon Redshift | Amazon Web Services | Apache AirflowFully remote | Mentorship opportunities | On-call supportSenior-level Full TimeOrlando, FL, United States R14h ago
-
Senior Data Engineer USD 140K-160KAirflow | Apache Spark | Auto Loader | CI/CD | Change Data Capture401k | Paid leave | Tuition reimbursementSenior-level Full TimeNorth Hollywood, CA, United States14h ago
-
Senior Data Engineer – Hardware & Supply Chain USD 147K-203KAWS | Apache Iceberg | DBT | Data Governance | Data ModelingFlexible wellness time off | Paid Holidays | Paid sick leave | Paid time off | Parental leaveSenior-level Full TimeHybrid - San Francisco, California R14h ago
-
Mid-level Full TimeMiami Lakes, FL, United States16h ago
-
Robotics Software Intern – Real-Time Controls USD 80K-116KActuators | C++ | Control Systems | Coordinate systems | EncodersEntry-level InternshipAustin, TX16h ago
-
Hive | Microstrategy | MySQL | Oracle | Python401k | Dental insurance | Disability insurance | Firm paid holidays | Flexible spending accountEntry-level Full TimeWashington, DC, United States16h ago
-
Senior AI Engineer USD 193K-240KAPI | Access Control | Audit Logging | CI/CD | Cloud Native401k employer match | Dental insurance | Dependent care FSA | Employer paid commuter benefit | Flexible time offSenior-level Full TimeDallas, Texas, United States17h ago
-
Agile | Calculus | Classification | Linear Algebra | Machine LearningSenior-level Full TimeMc Lean, VA, United States19h ago
-
Agile | Amazon Web Services | As-a-Service | Calculus | ClassificationMid-level Full TimeTysons, VA, United States19h ago
-
Algorithms | Data Structures | Java | JavaScript | LLM toolsSenior-level Full TimeMc Lean, VA, United States19h ago
-
AWS | Autogen | Automated testing | Azure | CI/CDOnsite workSenior-level ContractDallas, United States21h ago
-
Databricks Engineer USD 97K-162KAPI Integration | Agile | Data Governance | Data Modeling | Data QualityMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …21h ago
-
Data Scientist, Innovation Hub USD 108K-108KAudit Logging | Azure | CI/CD | Federated identity | Integration TestingCareer growth | Healthcare | On-site childcare | PTO | Paid HolidaysMid-level Full TimeTexas-Dallas-5323 Harry Hines Blvd21h ago
-
Databricks Engineer USD 107K-179KAPI Integration | Agile | Cloud Computing | Data Governance | Data ModelingTravel 10 to 15 percentMid-level Full TimeArlington/Rosslyn, Virginia, United States; Baltimore, Maryland, …21h ago
-
Senior Data Engineer USD 133K-158KAKS | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksSenior-level Full TimeCincinnati, Ohio, United States21h ago
-
AI Program Lead USD 159K-265KAI Governance | Agent-Based Artificial Intelligence | Agent-based | Artificial Intelligence | Business IntelligenceMentorship | Professional development | Travel up to 25 percentSenior-level Full TimeArlington/Rosslyn, Virginia, United States21h ago
-
Associate BI Analytics Engineer USD 98K-163KDAX | Data Modeling | Data Warehousing | Databricks | ELTMid-level Full TimeUSA-VA-Herndon21h ago
-
Senior Software Engineer - Data & Analytics Federation USD 160K-240KApache Arrow | Asynchronous frameworks | C++ | Distributed Systems | Linux401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysSenior-level Full TimePrinceton21h ago
-
Data Engineer, Employee Technology Support USD 110K-130KCause analysis | Data Governance | Data Modeling | Data Monitoring | Data Quality401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeNew York21h ago
-
AI orchestration | Alerting | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Savings plan options | Vision insuranceSenior-level Full TimeSan Francisco, CA, United States R22h ago
-
A/B | A/B Testing | APIs | Anthropic | B testingDental insurance | Medical insurance | PTO | Remote | Savings plan optionsMid-level Full TimeSan Francisco, CA, United States R22h ago
-
Alerting | Batching | Caching | Distributed Systems | DockerDental insurance | Medical insurance | Paid time off | Remote work | Savings planMid-level Full TimeSan Francisco, CA, United States R22h ago
-
Security Engineer III - AI/ML USD 170K-215KAPI Development | AWS | Anomaly Detection | Azure | BERTSenior-level Full TimePlano, TX, United States22h ago
-
Agent Orchestration | Bias Mitigation | Data Structures | Data Structures and Algorithms | Graph theorySenior-level Full TimeSunnyvale, CA | Bellevue, WA | …22h ago