Data Engineer II
Tasks
- Automate manual processes
- Design data pipelines
- Design data solutions
- Develop data pipelines
- Ensure pipeline accuracy
- Gather requirements from end-users
- Implement data exchange systems
- Integrate structured and unstructured data
- Maintain development, test, and production environments
- Optimize performance and coding best practices
- Participate in on-call rotation
- Support data pipelines
- Test and verify code before production
- Transform data
Perks/Benefits
Skills/Tech-stack
API Development | AWS | Apache Airflow | Apache Spark | Azure | Batch Processing | Cloud services | Data Modeling | Data Pipelines | Data integration | Docker | Git | Google Cloud | Java | Jenkins | Kubernetes | Message queuing | MySQL | PostgreSQL | Python | SQL | Snowflake | Stream processing | Streaming processing | Structured data | Unstructured Data
Education
N/A
Roles
Related jobs
-
Senior Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C Programming | C programming language | C#401k employer match | Cell phone reimbursement | Dinner provided twice weekly | EV charging | Flexible PTOSenior-level Full TimeEl Segundo, California, United States9h ago
-
Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | Cell phone reimbursement | EV charging | Flexible PTO | HSA employer matchEntry-level Full TimeEl Segundo, California, United States9h ago
-
Analytics Engineer USD 130K-175KAmazon Redshift | BigQuery | Business Intelligence | CRM data | CRM data modelingEntry-level Full TimeStockholm R16h ago
-
Lead Embedded Software Engineer USD 211K-286KAerospace Standards | Agile | Bitbucket | C++ | CentOSSenior-level Full TimePhoenix, AZ16h ago
-
Senior-level Full TimeAustin, TX1d ago
-
Full Stack Gen AI Engineer USD 128K-197KAWS Bedrock | AWS Fargate | Amazon ECS | Amazon Web Services | CI/CDSenior-level Full TimeDallas, Texas, United States1d ago
-
Senior Software Engineer, AI Developer Experience USD 200K-400KAlerting | Build systems | CI/CD | Caching | DashboardsDaily lunches & snacks | Disability benefits | Life insurance | Medical/Dental/Vision insurance | Parental leaveSenior-level Full TimeSan Francisco1d ago
-
Senior Data Engineer USD 140K-216KAPI Integration | Airflow | Alerting | Amplitude | BigQuery401k match | Casual dress environment | Development dollars | Disability insurance | Life insuranceSenior-level Full TimeEdmond, OK1d ago
-
Senior Software Engineer, Robotics Platform USD 143K-241KC# | C++ | CUDA | DDS | LinuxHigh ownership team | On-site work scheduleSenior-level Full TimeSan Francisco1d ago
-
Software Engineer IV USD 10KAgile | Apache NiFi | Bash | Configuration Management | Confluence401k contribution | Health allowance | Technology allowance | Technology lab access | Training and education benefitSenior-level Full TimeAnnapolis Junction, MD1d ago
-
Senior-level Full TimeMountain View, CA1d ago
-
Mechatronic/Robotics Engineer or Systems Integration Engineer - Camera and Sensor Calibration USD 132K-200KAR/VR | Bash | C++ | Calibration Techniques | Camera systemsOnsite workMid-level Full TimeMountain View, CA1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KARM | C# | C++ | Command and control | Communication ProtocolsMid-level Full TimeSan Francisco, CA1d ago
-
API Development | Ablation Studies | Agent systems | CI/CD | Cloud ComputingDonation matching | Flexible PTO | Health insurance | Lunch stipend | Team building eventsEntry-level InternshipBerkeley, California, United States; San Francisco, …1d ago
-
Senior-level Full TimeUnited States1d ago
-
Senior-level Full TimeUnited States1d ago
-
AI | ClickHouse | Confluence | ETL | Git401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeColumbia, Maryland1d ago
-
Data Governance | Data Modeling | Data Structures | Data pipeline | Java401k matching | Educational assistance | Federal Holidays | Healthcare coverage | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 2 - (Cloud, Analytics, Spark) USD 208K-254KAlgorithm Development | Data Querying | MapReduce | NoSQL | NumPy11 federal holidays | 24 days PTO | 401k 100 Percent Vested | Education assistance | Healthcare coverageSenior-level Full TimeAnnapolis Junction, Maryland; Annapolis Junction, Maryland1d ago
-
Software Engineer 1 - (Python, UI/UX, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Containerization | Docker401k match | Educational assistance | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer 1 - (AI, Python, LLMs) USD 163K-199KAWS | Argo CD | CI/CD | Docker | Helm401k match | Federal Holidays | Health insurance | Paid time offMid-level Full TimeAnnapolis Junction, Maryland1d ago
-
Software Engineer, Machine Learning Infrastructure USD 140K-230KAPI Development | AWS | Airflow | Alerting | CI/CD401k access | Flexible PTO | Health, dental, vision coverage | Paid mealsMid-level Full TimeSan Francisco, CA, US1d ago
-
APIs | AWS | Apache Spark | Azure | Azure Data401k matching | Dental insurance | Flexible working arrangements | Health insurance | Life insuranceSenior-level Full TimeSkokie, United States1d ago
-
Anomaly investigation | Bitbake | Bitbucket Pipelines | C# | C++Travel up to 20 percentMid-level Full TimeHerndon, United States1d ago
-
Data Engineer, PDPO - Offense & Defense USD 147K-269KApache Spark | ClickHouse | Data Modeling | Data Warehousing | Distributed SystemsEntry-level Full TimeSan Jose, California, United States1d ago