Data Engineer
Alexandria, Virginia, United States
R
USD 119K-202K (estimate) Mid-level Full Time
Tasks
- Build event driven ingestion with Azure Functions
- Build integrations with Logic Apps
- Configure Databricks clusters
- Design end-to-end data pipelines
- Develop PySpark data transformations
- Develop Python data processing
- Document architecture decisions
- Document runbooks
- Implement data governance controls
- Ingest data from REST APIs
- Ingest data from flat files
- Ingest data from relational databases
- Manage Azure Data Lake Storage Gen2 resources
- Manage Databricks workspaces
- Optimize pipeline performance
- Orchestrate data workflows with Azure Data Factory
- Schedule and monitor data workflows
- Troubleshoot pipeline failures
- Validate data quality
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Functions | Azure Storage | DAX | Data Factory | Data Lake Storage Gen2 | Databricks | Logic Apps | Power BI | PySpark | Python | REST APIs | SQL | Unity Catalog
Education
Bachelor of Arts | Bachelor of Engineering | Bachelor of Information Systems | Bachelor of Science
Roles
Regions
Countries
States
Cities
Related jobs
-
Senior Software Engineer, Data Engineering USD 243K-295KAWS | Apache Airflow | Apache Spark | Azure | Cloud ComposerSenior-level Full TimeSan Mateo, CA, United States R4h ago
-
Senior Backend Engineer, Experimentation USD 182K-263KA/B | A/B Testing | APIs | Alerting | B testingDental insurance | Health insurance | Mental health benefits | Restricted stock units | Vision insuranceSenior-level Full TimeRemote - US R9h ago
-
Biometrics | C++ | Computer Vision | Machine Learning | Multimodal LearningOffice three days per week | Relocation assistanceMid-level Full TimeSan Francisco R10h ago
-
Software Engineer - Backend Platform USD 140K-205KAPI Design | AWS | Cloud platform | Databases | Distributed SystemsComprehensive health coverage | Coworking stipend | Equity | Flexible savings accounts | Remote workMid-level Full TimePalo Alto, California, United States R10h ago
-
Backend Engineer, AI Engineering: Duo Chat USD 115K-194KAPI Design | GraphQL | Langchain | Langgraph | Language ModelsEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, Canada; Remote, United States R12h ago
-
Machine Learning Engineer USD 210K-240KA/B | A/B Testing | B testing | Data Pipelines | Data Processing401k plan | Commuter benefits | E Bike Transportation | Generous PTO | Learning and development stipendMid-level Full TimeSan Francisco, CA (Hybrid) R13h ago
-
Data Engineer USD 130K-150KApache Spark | Azure | Azure DevOps | CI/CD | Data ContractsFree dog walking services | Free on-site gym | Free parking | Hybrid remote work | Medical/Dental/Vision insuranceMid-level Full TimeSeattle, United States R13h ago
-
Data Engineer II USD 130K-150KAWS | Airflow | CI/CD | CloudWatch | Containerization401k matching | Employee equity plan | Fertility and adoption reimbursement | Flexible time off | Health insuranceMid-level Full TimeUnited States R14h ago
-
Senior Algorithms and Simulation Software Engineer USD 95K-145KC++ | CI/CD | Control Systems | Git | Hardware-in-the-loopSenior-level Full TimeDevens, MA R14h ago
-
Machine Learning Engineer USD 162K-170KComputer Vision | Data Pipelines | Deep learning | Experiment design | Machine Learning401k plan | Dental insurance | Flexible work hours | Long-term disability | Medical insuranceMid-level Full TimeRemote, United States R15h ago
-
APIs | Anomaly Detection | Classification Pipeline | Evaluation | HuggingFace Transformers100 percent remote | BYOD | Eastern Time overlap | USD paymentSenior-level Full TimeRemote R15h ago
-
Staff Software Engineer (L4) Data Platform USD 171K-213KAWS | Apache Hadoop | Apache Hudi | Apache Kafka | Apache Spark401k retirement account | Health care insurance | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R16h ago
-
Staff Machine Learning Engineer USD 176K-308KA2A | Asyncio | Embeddings | FastAPI | Java401k match | ESPP | Family leave | Flexible spending accounts | Flexible time offSenior-level Full TimeSanta Clara, California, United States R16h ago
-
Associate AI Engineer, Finance Transformation USD 145K-167KAPI Integration | Agent Frameworks | Data dashboards | LLM APIs | Language ModelsMid-level Full TimeSan Francisco - CA; New York … R17h ago
-
Senior-level Full TimeRemote or VA, VA, United States R17h ago
-
Embedded Software Engineer II USD 90K-115KC# | C++ | Driver Development | Embedded Linux | Interrupts401k | Bereavement leave | Dental insurance | FMLA | Health insuranceMid-level Full TimeCentennial, CO, United States R18h ago
-
Embedded Software Engineer III USD 100K-135KC# | C++ | Linux | MAC addresses | Memory Management401k retirement plan | Bereavement leave | Dental insurance | FMLA | Medical insuranceSenior-level Full TimeCentennial, CO, United States R18h ago
-
Associate Data Engineer USD 60K-60KAWS | Apache Spark | Azure | Data Analysis | Data MappingComprehensive health coverage | Equity | Growth-focused environment | Home office setup allowance | Monthly cell phone allowanceMid-level Full TimeRemote US R18h ago
-
Automated Speech Recognition | CI/CD | CUDA | Computer Vision | Containerization401k matching | Company events | Dental coverage | Flexible work schedules | Internet reimbursementSenior-level Full TimeAnnapolis Junction, MD R18h ago
-
Practice Architect AI/ML USD 136K-204KAWS | Agent Orchestration | Agentic Workflows | AutoGen Orchestration | Autogen401k retirement plan | Employee assistance program | Health spending account | Life insurance | Long-term disabilitySenior-level Full TimeHanover, Maryland, USA R18h ago
-
4G | 5G | Automation | Network Analysis | Network TroubleshootingEducational assistance | Paid Holidays | Paid vacation | Sick leave | Stock purchase planMid-level Full TimePlano,Texas,United States R19h ago
-
ArgoCD | CSI | Cluster API | Distributed Systems | FluxCompany outings | Conference attendance | Hackathons | Happy hours | Professional developmentSenior-level Full TimeRemote, USA, United States R19h ago
-
Senior Data Engineer (GCP • Python • Iceberg • Delta Lake • Kafka • Snowflake • Databricks) USD 165K-195KApache Iceberg | Apache Spark | BigQuery | Change Data Capture | Cloud platform401k | Dental insurance | Medical insurance | Paid time off | Pet insuranceSenior-level Full TimeU.S. Remote R19h ago
-
AI DevOps Engineer USD 140K-175KAWS | AWS Control Tower | AWS Organizations | Amazon Bedrock | Amazon SageMakerEducation reimbursement | Health plans | Hybrid option | In-office perks | Parental leaveMid-level Full TimeRemote - USA; San Jose, California, … R19h ago
-
Senior Data Engineer - Revenue Data Platform USD 192K-240KApache Airflow | Apache Iceberg | Apache Spark | Billing | Cause analysisSenior-level Full TimeBoston, Massachusetts, USA; New York, New … R20h ago