Senior Data Engineer
- Full-time
- Location: Philippines
- Department: Solutions
- Remote friendly: Yes
Company Description
Globant’s Commerce Studio helps organizations create best-in-class commerce-enabled experiences, with engineering and design at its core. The goal is to meet the demands of tomorrow's customers, leveraging long-standing expertise with large and complex commerce transformations in both B2B, B2C and D2C domains.
As an award-winning partner of enterprise-class platforms: Salesforce Commerce Cloud, Adobe Magento Commerce, and other API first, Headless Commerce surround solutions, we help clients create a competitive advantage with commerce at its core.
Our mission is to empower companies to succeed and thrive in the ever-changing digital landscape by building best-in-class future-ready digital commerce solutions globally.
Job Description
- Design, build, and maintain scalable data pipelines using PySpark and Databricks
- Optimize data processing and storage for maximum performance and efficiency
- Troubleshoot and debug data-related issues, and implement solutions to prevent reoccurrence
- Collaborate with data scientists, software engineers, and other stakeholders to ensure that data solutions are aligned with business goals
Qualifications
- Strong experience in Python programming and PySpark, and SparkSQL
- Clear understanding of Spark Data structures, RDD, Dataframe, dataset
- Expertise in Databricks and ADLS
- Expertise handling data type, from dictionaries, lists, tuples, sets, arrays, pandas dataframes, and spark dataframes
- Expertise working with complex data types such as, structs, and JSON strings.
- Clear understanding of Spark Broadcast, Repartition, Bloom index filters
- Experience with ADLS optimization, partitioning, shuffling and shrinking
- Ideal experience with disk caching
- Ideal Experience with cost based optimizer
- Experience with data modeling, data warehousing, data-lake, delta-lake and ETL/ELT processes in ADF
- Strong analytical and problem-solving skills
- Excellent documentation, communication and collaboration skills
Additional Information
- Work with professionals who have created some of the most revolutionary solutions in their fields.
- Make an impact. Work in large-scale projects globally.
- Develop your career in our Studios. Each Studio represents deep pockets of expertise on the latest technologies and trends and delivers tailored solutions focused on specific challenges.
- Develop your career within an industry or multiple industries.
- Work in the city you want, and be nourished by cultural exchanges.
- Be empowered to choose your career path: we have more than 600 simultaneous projects, so you can choose where and how to work.
- Be part of an agile pod. Driven by a culture of self-regulated teamwork, each team -or POD- works directly with our customers with a full maturity path that evolves as they increase speed, quality and autonomy.