Big Data Applications Specialist

Job Description:

• Project Description:

  We are looking for a Junior Big Data Application Engineer to join our Data & AI Team in Poland. You will be responsible for maintaining data ingestion pipelines and, when possible, enhancing and improving existing processes and applications. Our environments leverage Azure Cloud, Google Cloud, and Generative AI components, allowing you to work with cutting-edge technologies while delivering services to international clients and business users worldwide.

  
  Our Primary Tech Stack:

  • Azure / Google Cloud, SQL, Python, Databricks, Airflow, Databases, Linux, GitHub, Docker, Kubernetes, Data File Formats, Spark, Azure Machine Learning Studio, Grafana.

   
  Secondary Tech Stack:

  • API, Azure Data Factory, Azure DevOps, Azure SQL Databases, BigQuery, CI/CD, Cloud Storage, Composer, Crontab, Data Lake Storage, Dataproc, Docker, GitHub, Jira / Confluence, Kubernetes, PubSub, Scala, Transfer Service, Selenium, OpenAI and Imagen models, Azure and Google Cloud metrics.

• Responsibilities:

  • Ensure seamless data delivery from external sources on Microsoft Azure or Google Cloud platforms, making data accessible to data scientists and analysts using the latest technologies.

  • Adapt applications to meet evolving customer expectations and incorporate updates from data providers.

  • Continuously optimize application performance and implement cost-effective solutions.

  • Respond promptly to disruptions, ensuring smooth operations and expected outcomes.

  • Collaborate with diverse international and multicultural teams to deliver data and microservices.

  • Investigate and analyze root causes of issues, conducting deep dives as needed.

  • Support applications leveraging Generative AI models.

  • Extend unit test coverage to improve code reliability.

  • Monitor applications through metrics, dashboards, and alerts to ensure optimal performance.

• Mandatory Skills Description:

  • Strong analytical skills and the ability to think abstractly.

  • Proficiency in SQL, Python, and database technologies.

  • Fluency in both English and Polish.

  Experience with:

  • Relational and non-relational databases.

  • Linux-based environments.

  • Code versioning and CI/CD systems.

  • Containerization in local and clustered environments.

  • Spark and cluster computing

  • Orchestration and job scheduling tools.

• Nice-to-Have Skills Description:

  • Passion for cloud technologies and a desire to explore new areas independently.

  • Broader IT experience beyond data-centric roles.

  Familiarity with:

  • Generative AI models and prompt engineering.

  • Data transfer schemes and protocols.

  • Various data file formats.

  • Machine Learning implementation and deployment into production.

  • Datapipe setup and maintenance.

  • Operationalization of applications.

  • Monitoring, observability, and alerting systems.

  • Regression testing and scope validation.

Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services, such as false websites, or through unsolicited emails claiming to be from the company. These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process. DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process, nor ask a job seeker to purchase IT or other equipment on our behalf. More information on employment scams is available here.