Data Engineering

  • 5.0 Rate

  • 33 Lecture

  • 99 hours

  • 17 Weeks

Data Engineering is the foundation on which the modern Data ecosystem stands. At its core, the goal of data engineering is to design and develop systems and infrastructure that automatically collect, store, and analyze data. Primarily, data engineering aims to develop methodologies and tools that ensure maximum process perfection, information sustainability, and reliability.

Along with fundamental concepts, students will learn to use key technologies and tools for data engineering such as Apache Airflow, Apache Kafka, temporary and persistent data storage systems (SQL, PostgreSQL, Redis), designing web services for data (FastAPI), and various Python libraries. They will understand how different technologies/tools interact with each other and how theoretical concepts help in perfecting practice.

Outcome

Skills Acquired: Python, FastAPI, Apache Airflow, Apache Kafka, Data Workflow, Data Merting, Data Warehousing, PostgreSQL, Redis, SQL,

  • Use Python for data transformation and manipulation

  • Practically apply Python's data engineering and database libraries

  • Design architectural designs for high-performance and sustainable projects

  • Set up and design high-performance web services (FastAPI)

  • Ensure data sustainability and quality

  • Differentiate and implement ETL and ELT processes in various Data projects

  • Set up, orchestrate, design, and analyze data transformation processes

  • Work with temporary and persistent data storage systems (Redis and Postgres)

  • Practically use Apache Airflow, a data flow orchestration and design system

  • Understand the concepts of DAGs and Schedulers

  • Analyze and design Data Workflow systems

  • Understand the fundamental concepts of Apache Kafka

  • Practically work with Data Streams and Message Brokers

  • Analyze/design dependencies and relationships between data

  • Understand and work with principles of various data storage concepts (Data Warehousing, Data Marting)

Nov 19 2500₾

Tue-Thu 20:00-22:00

Apr 15 2500₾

Tue 20:00-23:00, Sat 12:00-15:00

Split your payment
TBC installment
BOG installment

Who is this course for?

Developers

Someone who has already started learning Python and has an analytical, detail-oriented mindset.

Data analysts

For data analysts who know the basics of Python and want to develop their career.

Program includes

Alumni Club

After successfully completing the final exam, graduates will be automatically enrolled in the Alumni Club. This membership grants them access to exclusive events, content, and special offers from our partner companies

Work Based Learning

The course includes practice-based learning, including assignments/exercises and individual projects.

Bilingual Certification

Upon successful completion of the course, students will receive a bilingual certificate.

Graduate feedback

5.0 Rate

Syllabus

What is Data Engineering
Data Engineer's responsibilities
Data-oriented thinking
Perfectionism
Dataclasses
Functional Programming and "Sequential code"
Generators
Lab session / Lecture and practical assignment
Context managers
Error handling
Modules and packages
Higher-order functions
Lab session / Lecture and practical assignment
Overview of pandas library
What is DataFrame
Python and pandas
Simple DataFrame operations (selection, filtering, indexing)
Lab session
Grouping data in Pandas DataFrame
Data aggregation
Data Cleaning and Handling
Merge, Join operations

Pick your suitable time

Lecturers

Levan Alibegashvili

Data Engineering

Levan Alibegashvili

Data Engineering

Levan has many years of experience working as a data engineer and scientist. He currently holds the position of Senior Data Engineer at DataArt, where he works on setting up SnowFlake storage and automating data input. Previously, Levan held the position of Data Lead at EPAM Systems, where his main activities included data migration, development of ETL/ELT processes, and business analytics. Levan has work experience in both large international companies (FedEx Ground Services, Betsson Group) and the public sector (Ministry of Agriculture of Georgia, National Bank of Georgia). His career includes diverse positions - from Big Data Unit Head to Policy Advisor, which gives him a unique perspective in the field of data science. Levan has also actively worked as a freelancer, where he served as an expert in Microsoft Excel and Power BI. He has extensive experience in technologies such as Python, SQL, Snowflake, as well as in developing and implementing machine learning models.

Linkedin

FAQs for this course

A: Data Engineering is increasingly vital in today's digital world. It bridges the gap between raw data and actionable insights, enabling businesses to make informed decisions. Data Engineers build and maintain the infrastructure that processes massive amounts of data, making it accessible and useful for analysis. This field offers excellent career prospects, competitive salaries, and the opportunity to work with cutting-edge technologies while solving complex real-world problems.
A: The course requires basic knowledge of Python, analytical and detail-oriented thinking abilities, as well as English language proficiency at B2 level. A strong interest and motivation to work with data is essential.

Your search Digital Designer did not match any documents

Unable to locate relevant information?

Get Free consultation

You may interest