Data Engineer Self Service Analytics and Real Time Data Platforms
Tasks
- Build AI ready data products for machine learning and GenAI
- Build near real time streaming data pipelines
- Create semantic layers and metrics frameworks
- Design governed data access patterns for AI and conversational analytics
- Design scalable ETL/ELT pipelines
- Design scalable analytics and AI optimized data models
- Develop curated data products
- Enable governed self service business data models
- Ensure data quality governance metadata and discoverability
- Implement data monitoring and observability
- Implement real-time dashboards
- Integrate data pipelines with ML platforms
- Optimize complex SQL queries
Perks/Benefits
- 401k
- Dental insurance
- Disability benefits
- Life insurance
- Medical insurance
- Paid time off
- Tuition assistance
- Vision insurance
Skills/Tech-stack
Airflow | Apache Kafka | Cloud Pub/Sub | Cloud platform | Data Governance | Data Modeling | Data Pipelines | Data Quality | Data Warehouse | Databricks | Distributed Systems | ELT | ETL | Embeddings | Event Driven | Event-driven architecture | Feature Engineering | GCP | GenAI | Google Cloud | Google Cloud Platform | Google Cloud Pub/Sub | Kafka Streams | Lakehouse | Machine Learning | Metadata Management | Observability | Pub/Sub | Python | SQL | Spark | Streaming Data | Streaming data pipelines | Superset | Vector Databases | Vertex AI
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
AWS | Agile | Confluence | Django | Docker401k match | Career development | Dental insurance | Health insurance | HolidaysSenior-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
Agile | Ansible | Apache NiFi | Automation | Continuous Monitoring401k employer contribution | Career development and training | Holiday pay | Paid health dental and vision premiums | Paid time offSenior-level Full TimeLinthicum Heights, MD; Laurel, MD; Laurel, …1h ago
-
AWS | Agile | Confluence | Data Gathering | Django401k employer contribution | Career counseling | Education and training support | Employee referral bonuses | Flexible work-life balanceMid-level Full TimeLinthicum Heights, MD; Linthicum Heights, MD; …1h ago
-
Cloud Big Data Software Engineer USD 130K-182KAWS | Apache Spark | Azure | Distributed Systems | Docker401k matching | Birthday day off | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeTysons, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Big Data Software Engineer USD 102K-215KAWS | Apache Kafka | Apache Spark | Azure | Cloud platform401k match | Birthday day off | Disability insurance | Employee and family events | Flexible work scheduleMid-level Full TimeSan Antonio, TX; Aurora, CO; Chantilly, …1h ago
-
Cloud Big Data Software Engineer USD 135K-206KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Distributed Systems401k matching | Birthday day off | Flexible work schedule | HSA or FSA | Health insurance coverageMid-level Full TimeReston, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Big Data Software Engineer USD 150K-206KAWS | Apache Kafka | Apache Spark | Azure | Cloud platform30 days paid leave | 401k matching | 401k profit sharing | AFLAC | Birthday day offMid-level Full TimeHonolulu, HI; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Big Data Software Engineer USD 135K-206KAWS | Azure | Data Visualization | Distributed Systems | Docker401k matching | Birthday day off | Employee events | Flexible work schedule | HSA/FSAMid-level Full TimeChantilly, VA; Aurora, CO; Honolulu, HI; …1h ago
-
Cloud Big Data Software Engineer USD 138K-206KAWS | Azure | Distributed Systems | Docker | GCP401k matching | Birthday day off | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeAurora, CO; Chantilly, VA; Honolulu, HI; …1h ago
-
Cloud Big Data Software Engineer USD 179K-235KAmazon Web Services | Apache Kafka | Apache Spark | Cloud platform | Data Visualization401k matching | Birthday day off | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeAnnapolis Junction, MD; Aurora, CO; Chantilly, …1h ago
-
Cloud Analytic Software Engineer USD 135K-182KAWS | Apache Spark | CI/CD | Cloud platform | Distributed Systems401k matching | Birthday day off | Career support | Employee and family events | Flexible work scheduleMid-level Full TimeTysons, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 100K-215KAWS | Azure | CI/CD | Docker | GCPBirthday day off | Employee referral program | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeSan Antonio, TX; Aurora, CO; Chantilly, …1h ago
-
Cloud Analytic Software Engineer USD 135K-190KAWS | Azure | CI/CD | Distributed Systems | DockerBirthday day off | Career support | Employee referral program | Flexible work schedule | Paid leaveMid-level Full TimeReston, VA; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 135K-206KAWS | Apache Spark | CI/CD | Cloud platform | Distributed SystemsBirthday day off | Flexible work schedule | Paid leave | Paid training | Referral programMid-level Full TimeHonolulu, HI; Aurora, CO; Chantilly, VA; …1h ago
-
Cloud Analytic Software Engineer USD 135K-190KAWS | Azure | CI/CD | Cloud Cost Optimization | Cost OptimizationBirthday day off | Flexible work schedule | Paid leave | Paid training | Referral bonus programMid-level Full TimeChantilly, VA; Aurora, CO; Honolulu, HI; …1h ago
-
Cloud Analytic Software Engineer USD 135K-206KAWS | Azure | CI/CD | Cloud Cost Optimization | Cost Optimization401k matching | 401k profit sharing | AFLAC | Birthday day off | Cafeteria style benefitsMid-level Full TimeAurora, CO; Chantilly, VA; Honolulu, HI; …1h ago
-
Cloud Analytic Software Engineer USD 150K-235KAmazon Web Services | Apache Spark | CI/CD | Cloud platform | Data StreamingBirthday day off | Employee Family Events | Flexible work schedule | Paid leave | Paid trainingMid-level Full TimeAnnapolis Junction, MD; Aurora, CO; Chantilly, …1h ago
-
Natural Language Processing (NLP) Specialist USD 100K-115KData Visualization | Deep learning | Information Retrieval | Language Processing | Machine LearningBirthday day off | Comprehensive health coverage | Flexible work schedule | HSA/FSA | Life insuranceMid-level Full TimeAnnapolis Junction, MD; Annapolis Junction, MD; …2h ago
-
ActiveMQ | Agile | Amazon Web Services | Apache Beam | Apache CassandraMid-level Full TimeSan Mateo, CA; Irving, TX; Sunnyvale, …2h ago
-
Senior-level Full TimeSan Bruno, CA; San Bruo, CA; …2h ago
-
Mid-level Full TimeSunnyvale, CA; San Bruno, CA; Dallas …2h ago
-
API | Amazon Web Services | Amazon Web Services (AWS) | Apache HDFS | Apache SparkRemote workMid-level Full TimeRemote, US; Sunnyvale, CA; Dallas, TX R2h ago
-
Adobe Analytics | Airflow | Apache Hive | Apache Spark | Data LineageSenior-level Full TimeSan Bruo, CA; San Bruno, CA; …2h ago
-
Airflow | C++ | Data Pipelines | Distributed Computing | ElasticsearchSenior-level Full TimeSunnyvale, CA; Palo Alto, CA; St. … R2h ago