Senior Data Engineer
USD 149K-166K (estimate) Senior-level Full Time
Tasks
- Build data lake and warehouse solutions
- Create ETL and ELT pipelines
- Create project plans and documentation
- Design scalable data pipelines
- Develop business rule management systems
- Develop data workflow orchestration pipelines
- Develop event driven data platform architecture
- Develop testable maintainable software with Python
- Implement CI/CD pipelines
- Implement Kafka based messaging frameworks
- Implement data governance & compliance
- Optimize workflows performance and reliability
- Perform data validation and monitoring
- Perform testing validation and troubleshooting
Perks/Benefits
- N/A
Skills/Tech-stack
AWS Crawler | AWS Glue | AWS Lambda | Aerospike | Agile | Airflow | Alteryx | Amazon Athena | Amazon EC2 | Amazon EMR | CI/CD | Continuous Delivery | Continuous integration | DB2 | Data Lakehouse | Denodo | Docker | Drools | ELT | ETL | Econometrics | Informatica | Java | Jenkins | Kafka | Kanban | Linear Regression | Linux | Microsoft SQL | Microsoft SQL Server | MongoDB | NumPy | Oracle | PL/SQL | Pandas | PostgreSQL | PowerBI | Probability | PySpark | Python | QuickSight | Redshift | S3 | SQL | SQL Server | Scikit-learn | Scrum | Series analysis | Shell | Snowflake | Splunk | Tableau | Talend | TensorFlow | Teradata | Terraform | Time Series | Time Series Analysis | Unix | YugabyteDB
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R6d ago
-
Mid-level Full Time上海、圣何塞3h ago
-
Data Engineer USD 110K-165KCause analysis | Data Analysis | Data Pipelines | Data Processing | Data TransformationSenior-level Full TimeFAIRFAX, VA, United States6h ago
-
Lead Data Engineer USD 114K-160KBusiness Objects | Business Process | Business Process Redesign | Case Development | Compliance AuditingSenior-level Full TimeColumbus, GA, United States7h ago
-
Azure Data -AI -Architect USD 119K-258KAzure Compliance | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsSenior-level Full TimeUSA8h ago
-
AWS | Cloud Computing | Columnar Storage | Dataframe optimization | JavaEquity | Full benefits | Hybrid work in office component required | Performance-focused culture | Startup environmentSenior-level Full TimeLos Angeles, CA, United States8h ago
-
Mid-level Full TimeNew York, NY, US9h ago
-
Senior-level Full TimeJersey City, NJ, United States10h ago
-
Applied AI/ML [Multiple Positions Available] USD 165K-195KAI Governance | AI governance framework | AWS | Azure | BM25Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States10h ago
-
AWS | AWS EMR | AWS Glue | Amazon S3 | Apache AirflowSenior-level Full TimePrinceton11h ago
-
Alerting | Data Governance | Data Modeling | Data Quality | Data Versioning401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceSenior-level Full TimePrinceton11h ago
-
Principal Software Engineer USD 105K-159KAWS | Agile | Azure | Bitbucket | CI/CDFlexible hybrid work model | Health and life insurance | Paid time off | Pension/retirement benefits | Personal/Family Care leavesSenior-level Full TimeTampa, FL, United States R11h ago
-
Sr. Robotics Engineer USD 124K-186KAgile | Bash | Build Servers | C# | C++401k | Adoption Assistance | Charitable contribution match | Defined contribution plan | Discount programsSenior-level Full TimeSanta Clara,California,United States11h ago
-
Senior Software Engineer, Infrastructure, Google Cloud USD 174K-253KApache Beam | Apache Spark | C++ | Compute architecture | Data AnalysisSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Software Engineer, Machine Learning, Travel Ads USD 147K-211KA/B | A/B Testing | Adbrain | B testing | C++Mid-level Full TimeMountain View, CA, USA12h ago
-
Cloud Technical Solutions Engineer, Storage and Database USD 150K-218KC# | C++ | Docker | HTTP | Java24x7 support coverageSenior-level Full TimeSunnyvale, CA, USA; Austin, TX, USA12h ago
-
Software Engineer III, Cloud Bigtable SQL and Analytics USD 147K-211KApproximate Nearest Neighbors | Beam | C++ | Concurrency | Consistency modelsSenior-level Full TimeNew York, NY, USA12h ago
-
BMC | C# | C++ | Cross-Functional Collaboration | Cross-functionalSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Material Science Research Engineer, DeepMind USD 147K-211KCalculus | Data Analysis | Deep learning | JAX | Linear AlgebraMid-level Full TimeMountain View, CA, USA12h ago
-
Algorithms | C++ | Cloud Storage | Data Analysis | Data StructuresSenior-level Full TimeSunnyvale, CA, USA12h ago
-
Research Engineer, Humanoids, DeepMind USD 147K-211KC++ | Debugging | Foundation Models | JAX | Language ProcessingMid-level Full TimeMountain View, CA, USA12h ago
-
Airflow | Apache Beam | Apache Flink | Apache Spark | BigQuerySenior-level Full TimeMountain View, CA, USA; New York, …12h ago
-
Senior Staff Engineer, GDC AI Inference Platform USD 262K-365KAgent coordination | C++ | Cloud infrastructure | Containerization | Data StructuresBonus | Equity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA12h ago
-
Business Intelligence - Data Engineer 133-2015 USD 80K-115KData Transformation | Data analytics | Data pipeline | Dependency management | ETLMid-level Full TimeTulsa, OK, US15h ago
-
Sr AI Engineer USD 115K-142KAgent systems | Agentic Workflows | CI/CD | Citation Grounding | Cloud ComputingSenior-level Full TimeAda, MI, United States, 4935516h ago