Senior Data Engineer
Tasks
- Automate workflows with Databricks Workflows
- Automate workflows with Jobs API
- Build and test data pipelines
- Collaborate with developers and analysts
- Create dashboards
- Debug data gaps
- Design data structures and schemas
- Design data validation test cases
- Diagnose data quality issues
- Implement CI/CD pipelines
- Integrate code with GitHub
- Integrate code with GitLab
- Manage database objects in development
- Optimize ETL processes
- Orchestrate Databricks workflows
- Plan and design data pipelines
- Write SQL queries and reports
Perks/Benefits
Skills/Tech-stack
AWS | AWS Glue | Airflow | Apache Spark | Azure | CI/CD | Databricks | Databricks Workflows | ETL | GitHub | GitLab | Google Cloud | Jobs API | Kafka | SQL
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Regions
Countries
States
Related jobs
-
Mid-level Full TimeFAIRFAX, VA, United States6h ago
-
Actuators | C++ | Coordinate frames | Docker | GitMentorship | Training and documentation support | Travel 30 to 40 percentEntry-level Full TimeChicago, IL, United States8h ago
-
Deloitte Technology-US Associate GenAI Engineer USD 70K-86K.Net Core | AWS | Agile | Algorithms | AngularMid-level Full TimeHermitage, Tennessee, United States11h ago
-
Databricks Engineering Consultant USD 93K-155KAmazon Web Services | Apache Spark | Auto Loader | Cloud platform | Data ModelingMentorship | Professional development | Travel opportunitiesMid-level Full TimeArlington/Rosslyn, Virginia, United States; Sacramento, California, …11h ago
-
Consultant - Data Science / Data Lake USD 107K-188KAmazon Web Services | Apache Hadoop | Apache Kafka | Apache Spark | Apache StormEntry-level Full TimeChicago, Illinois, United States11h ago
-
Agile | Amazon Web Services | Cloud Platforms | Cloud platform | Data EngineeringMentorship | Professional development | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; Charlotte, North …11h ago
-
Java Full Stack Developer-Software Engineer II USD 93K-155KAPI Design | AWS | Ansible | Benchmarking | Best practicesMid-level Full TimeDallas, Texas, United States11h ago
-
Anthropic Forward Deployed Engineer - GPS USD 97K-171KAPI Integration | AWS | Airflow | Anthropic Claude | Anthropic Claude APIMentorship | Professional development opportunities | Reasonable accommodations | Travel 50% | US government security clearance supportMid-level Full TimeArlington/Rosslyn, Virginia, United States; Atlanta, Georgia, …11h ago
-
Lead Forward Deployed Engineer - AWS USD 189K-372KAPI Integration | AWS | Airflow | Amazon Bedrock | Bedrock AgentsMentorship | Professional developmentSenior-level Full TimeSan Jose, California, United States11h ago
-
Cloud Engineer - Project Delivery Senior Analyst USD 103K-173KAWS CloudFormation | AWS CloudWatch | AWS Lambda | Amazon EKS | Amazon Web ServicesSenior-level Full TimeDallas, Texas, United States11h ago
-
API Development | AWS | CI/CD | Distributed Systems | Docker401k match | Dental insurance | Life insurance | Medical insurance | Paid time offSenior-level Full TimeNew York11h ago
-
Senior Software Engineer, Generative AI, Core ML USD 174K-252KAgentic Applications | Automated testing | Computer Vision | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA12h ago
-
APIs | Agent systems | Cloud platform | Cost Per Request | CrewAIEmployee discounts | Health insurance | Paid time off | Retirement plansMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Software Engineer III, Generative AI, Agent Engineering USD 147K-211KArtificial Intelligence | BigQuery | CI/CD | Cloud Storage | Computer VisionSenior-level Full TimeKirkland, WA, USA12h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-252KAPIs | Agent systems | Cloud platform | Conversational AI | DebuggingTravel opportunitiesSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Mechanical Engineer, Data Center Technology Systems USD 171K-248KASME B31 | C++ | Fire Protection | Fuel Systems | HVACSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Forward Deployed Engineer II, Applied AI, Google Cloud USD 147K-211KAPI Integration | APIs | Agent systems | Cloud platform | Evaluation PipelinesTravel opportunitiesMid-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …12h ago
-
Senior Software Engineer, BigQuery Managed Storage USD 174K-252KBigQuery | C++ | Change Data Capture | Cloud platform | Data CaptureSenior-level Full TimeKirkland, WA, USA12h ago
-
Senior Data Platform Engineer, Remote USD 135K-180KAWS | AWS Lambda | Access Control | Amazon Aurora | Amazon CloudWatchSenior-level Full TimeUnited States, UNITED STATES, United States R18h ago
-
AI Software Engineer USD 181K-270KAWS | CI/CD | Docker | Edge Functions | GitHub CopilotComprehensive benefits | Equity | Learning stipend | Remote-first cultureSenior-level Full TimeUnited States or Canada R22h ago
-
Senior-level Full TimeLos Angeles, CA22h ago
-
Machine Learning Intern USD 80K-90KAWS | Apache Hive | Apache Spark | C++ | Cloud platformFinal evaluation | Mentorship | Performance feedbackEntry-level InternshipMountain View, USA22h ago
-
AWS | Data Governance | Data Lineage | Data Modeling | Data PipelinesMid-level Full TimeHawthorne, California, USA23h ago
-
Senior Data Engineer - Remote - Multiple Levels USD 85K-141KAWS Data | AWS Data Migration | AWS Data Migration Service | AWS Lambda | Airflow401k retirement plan | Dental insurance | Health insurance | Paid Holidays | Parental leaveSenior-level Full TimeHome Office: Tysons, VA, United States R23h ago
-
Mid-level Full TimeInnovation Point, United States23h ago