Python 3: from None to Machine Learning

Tip

This book is free and open source at http://python.astrotech.io

author	Matt Harasymczuk
email	matt@astrotech.io
www	http://www.astrotech.io
github	https://github.com/astromatt
linkedin	https://linkedin.com/in/mattharasymczuk
facebook	https://facebook.com/matt.harasymczuk
slideshare	https://www.slideshare.net/astrotech/presentations

Table 1. Other books from author

URL	Title
http://python.astrotech.io	Python 3: from None to Machine Learning
http://devops.astrotech.io	DevOps and CI/CD with Docker
http://jira.astrotech.io	Jira Software, Jira Service Desk and Jira Core
http://git.astrotech.io	GIT and GIT Flow
http://agile.astrotech.io	Agile Software Engineering: CI/CD with Scrum, Kanban, XP and Lean
http://arch.astrotech.io	Software Architecture, Cloud, Microservices
http://linux.astrotech.io	Linux and Shell Programming with Bash

Tip

If you're interested in training course on topics from this book, please email me at matt@astrotech.io

Workshop

Warning

Before training course please setup your environment as described here Installing Python.

• Python Foundations

• Python Intermediate

• Python Advanced

• Django Framework

• Python in Networking

• Python in Testing

• Python in Science and Engineering

• Python in Machine Learning

Introduction

Introduction

• 1. Installing Python
  • 1.1. System Requirements
  • 1.2. Setting-up Environment
• 2. References in the book
  • 2.1. Iris Dataset
  • 2.2. Ehlo World!
  • 2.3. Addresses
  • 2.4. Dates and timezones
  • 2.5. Main Characters
• 3. About Python Language
  • 3.1. What is Python?
  • 3.2. Which version?
  • 3.3. Scripts
  • 3.4. Python Console (REPL)
  • 3.5. Jupyter
• 4. IDE - Integrated Development Environment
  • 4.1. What is IDE?
  • 4.2. How to choose?
  • 4.3. Which one is the best?
  • 4.4. PyCharm
  • 4.5. Assignments
• 5. Syntax
  • 5.1. Indentation instead of braces
  • 5.2. End of lines
  • 5.3. Comments
  • 5.4. Variables and constants
  • 5.5. print()
  • 5.6. Assignments

Data Types

Data Types

• 1. int
  • 1.1. Defining int
  • 1.2. Converting to int
  • 1.3. Numerical Operators
  • 1.4. Numeric Functions
  • 1.5. Assignments
• 2. float
  • 2.1. Defining float
  • 2.2. Converting to float
  • 2.3. Numeric Functions
  • 2.4. Assignments
• 3. bool
  • 3.1. Defining bool
  • 3.2. Converting to bool
  • 3.3. Negative values
  • 3.4. Boolean logic
  • 3.5. Logic operators
  • 3.6. Assignments
• 4. None
  • 4.1. Defining None
  • 4.2. Logic operators
  • 4.3. Assignments
• 5. str
  • 5.1. Defining str
  • 5.2. Type casting to str
  • 5.3. Single or double quote?
  • 5.4. Escape characters
  • 5.5. Characters before strings
  • 5.6. Getting text from user
  • 5.7. Length of a str
  • 5.8. Assignments

Data Structures

Data Structures

• 1. list
  • 1.1. Initializing
  • 1.2. Adding elements
  • 1.3. sorted() vs. list.sort()
  • 1.4. Multiple statements in one line
  • 1.5. Membership Operators
  • 1.6. Built-in functions on sequences
  • 1.7. Length of a list
  • 1.8. Assignments
• 2. tuple
  • 2.1. Initializing
  • 2.2. Length of a tuple
  • 2.3. Assignments
• 3. set
  • 3.1. Initializing
  • 3.2. Adding items
  • 3.3. Converting to set deduplicate items
  • 3.4. Length of a set
  • 3.5. Assignments
• 4. dict
  • 4.1. Initializing
  • 4.2. Adding elements
  • 4.3. Accessing elements
  • 4.4. Length of a dict
  • 4.5. Assignments
• 5. Nested Collections
  • 5.1. list of tuple
  • 5.2. list of dict
  • 5.3. list of list
  • 5.4. Mixed types
  • 5.5. Assignments

Data Methods

Data Methods

• 1. str Methods
  • 1.1. String immutability
  • 1.2. String Arithmetic
  • 1.3. str methods
  • 1.4. Multiple statements in one line
  • 1.5. Cleaning str from user input
  • 1.6. Assignments
• 2. set Methods
  • 2.1. set.isdisjoint()
  • 2.2. set.issubset()
  • 2.3. set.issuperset()
  • 2.4. set.union()
  • 2.5. set.difference()
  • 2.6. set.symmetric_difference()
  • 2.7. set.intersection()
  • 2.8. Assignments
• 3. Indexes
  • 3.1. Accessing element with index
  • 3.2. Accessing element from start
  • 3.3. Accessing element from back
  • 3.4. Accessing not existing element
  • 3.5. Assignments
• 4. Slices
  • 4.1. Accessing range of elements
  • 4.2. Accessing slice from start
  • 4.3. Accessing slice from back
  • 4.4. Accessing slice not existing elements
  • 4.5. Accessing slice from all elements
  • 4.6. Arithmetic operations on slice indexes
  • 4.7. Every n-th element
  • 4.8. Reversing
  • 4.9. Slice data structures
  • 4.10. Slice function
  • 4.11. Assignments
• 5. Unpacking sequences
  • 5.1. Unpacking values
  • 5.2. Unpacking arbitrary number of arguments
  • 5.3. Unpacking values from function
  • 5.4. Example
  • 5.5. More advanced topics
  • 5.6. Assignments
• 6. Type System
  • 6.1. Type inference
  • 6.2. Type Annotations
  • 6.3. Problematic types
  • 6.4. Assignments

Control Flow

Control Flow

• 1. Conditional Statements
  • 1.1. if
  • 1.2. else
  • 1.3. Inline if
  • 1.4. elif
  • 1.5. Assignments
• 2. Composite statements
  • 2.1. Complex expressions
  • 2.2. Good practice
  • 2.3. Control Statements
  • 2.4. Assignments
• 3. Operators
  • 3.1. Operator precedence
  • 3.2. Assignments
• 4. while loop
  • 4.1. Syntax
  • 4.2. Example
  • 4.3. break and continue
  • 4.4. else
  • 4.5. Assignments
• 5. for loop
  • 5.1. Syntax
  • 5.2. Iterating over str
  • 5.3. Iterating simple collections
  • 5.4. Working with Generators and Iterators
  • 5.5. Example
  • 5.6. else
  • 5.7. Assignments
• 6. Iterating nested sequences
  • 6.1. Iterating over nested list items
  • 6.2. Unpacking values in loop
  • 6.3. Enumerating and item index
  • 6.4. Iterating over dict items
  • 6.5. Iterating complex types
  • 6.6. Assignments
• 7. Comprehensions
  • 7.1. Simple usage
  • 7.2. Generator expressions vs. Comprehensions
  • 7.3. Conditional Comprehension
  • 7.4. Examples
  • 7.5. Advanced usage for Comprehensions and Generators
  • 7.6. Assignments
• 8. Exceptions
  • 8.1. What are and why to use exceptions?
  • 8.2. Most common exceptions
  • 8.3. Raising exceptions
  • 8.4. Traceback
  • 8.5. Catching exceptions
  • 8.6. Exception hierarchy
  • 8.7. Defining own exceptions
  • 8.8. Real life use-case
• 9. Files
  • 9.1. Path
  • 9.2. Access modes
  • 9.3. Read from file
  • 9.4. Writing
  • 9.5. Exception handling
  • 9.6. Good Engineering Practises
  • 9.7. Assignments
• 10. Exam from basic topics
  • 10.1. Relational Files Database

Functions

Functions

• 1. Function Basics
  • 1.1. Function definition
  • 1.2. Returning values
  • 1.3. Function arguments
  • 1.4. Naming convention
  • 1.5. Variable scope
  • 1.6. More advanced topics
  • 1.7. Assignments
• 2. Defining function with arbitrary number of arguments
  • 2.1. Recap information about function parameters
  • 2.2. Arbitrary number of positional arguments
  • 2.3. Arbitrary number of keyword arguments
  • 2.4. Arbitrary number of positional and named arguments
  • 2.5. Keyword only
  • 2.6. Use cases
  • 2.7. Assignments
• 3. Passing many arguments
  • 3.1. Arbitrary number of positional arguments
  • 3.2. Arbitrary number of keyword arguments
  • 3.3. Arbitrary number of positional and keyword arguments
  • 3.4. Examples
  • 3.5. Assignments
• 4. Recurrence
  • 4.1. What is recurrence?
  • 4.2. Limit
• 5. Advanced Functions
  • 5.1. Type annotations
  • 5.2. Callable
  • 5.3. Assignments

Standard Library

Standard Library

• 1. Virtualenv
  • 1.1. venv Module
  • 1.2. Create Virtualenv
  • 1.3. Directory Naming Convention
  • 1.4. Activate Virtualenv
  • 1.5. Good practices
  • 1.6. Assignments
• 2. Installing Packages
  • 2.1. Searching
  • 2.2. Installing
  • 2.3. Assignments
• 3. Importing modules
  • 3.1. Importing modules
  • 3.2. What is Python Module
  • 3.3. Example
  • 3.4. Import path
• 4. Keywords
  • 4.1. pass
  • 4.2. __file__
  • 4.3. __name__
• 5. Builtin functions
  • 5.1. range()
  • 5.2. Sprawdzanie typów
  • 5.3. Działania na kolekcjach
  • 5.4. Konwersje typów
  • 5.5. Other builtin functions
  • 5.6. Assignments
• 6. Print Formatting
  • 6.1. print function
  • 6.2. String concatenation
  • 6.3. Variable interpolation
  • 6.4. Advanced String Formatting
  • 6.5. pprint
  • 6.6. Assignments
• 7. Regular Expressions
  • 7.1. Constructing Regular Expressions
  • 7.2. Most frequent used functions in re module
  • 7.3. RegEx parameters (variables)
  • 7.4. Multi line searches
  • 7.5. Greedy and non-greedy search
  • 7.6. Practical example of Regex usage
  • 7.7. Standards
  • 7.8. Good practices
  • 7.9. Assignments

Math

Math

• 1. Mathematics
  • 1.1. Builtin
  • 1.2. math
  • 1.3. Assignments
• 2. Statistics
  • 2.1. statistics
  • 2.2. Assignments
• 3. Random Numbers
  • 3.1. random
  • 3.2. Assignments
• 4. Fractions
  • 4.1. Defining fractions
• 5. Numerical Precision
  • 5.1. Problem
  • 5.2. float anatomy
  • 5.3. decimal
• 6. matplotlib
  • 6.1. Matplotlib and Jupyter
  • 6.2. Points
  • 6.3. Sinusoid on grid
  • 6.4. Multiple charts
• 7. complex
  • 7.1. Defining complex
  • 7.2. Arithmetic on complex
  • 7.3. Builtin functions

Date and Time

Date and Time

• 1. Dates and Time
  • 1.1. Creating date objects
  • 1.2. Creating time objects
  • 1.3. Creating datetime objects
  • 1.4. Assignments
• 2. Parsing and Formatting
  • 2.1. Date formats
  • 2.2. Time formats
  • 2.3. ISO 8601 Standard
  • 2.4. Table of date and time parsing and formatting parameters
  • 2.5. Date formatting
  • 2.6. Parsing dates
  • 2.7. Assignments
• 3. Time Deltas
  • 3.1. Time shifts
  • 3.2. timedelta
  • 3.3. Time diff
  • 3.4. Assignments
• 4. Timestamp
  • 4.1. What is timestamp?
  • 4.2. datetime
  • 4.3. time
  • 4.4. Assignments
• 5. Time Utils
  • 5.1. Sleep
  • 5.2. calendar
• 6. Timezones
  • 6.1. Time zones in datetime library
  • 6.2. pytz
  • 6.3. Assignments

Serialization

Serialization

• 1. CSV Serialization
  • 1.1. Reading data from CSV files
  • 1.2. Writing to CSV files
  • 1.3. Parsing non-CSV files with csv.DictReader()
  • 1.4. Pandas
  • 1.5. Assignments
• 2. JSON Serialization
  • 2.1. JSON syntax
  • 2.2. JSON Serialization of simple objects
  • 2.3. Serializing datetime and date
  • 2.4. Serializing objects
  • 2.5. Pretty Printing JSON
  • 2.6. Assignments
• 3. XML
  • 3.1. xml
  • 3.2. lxml
  • 3.3. xslt
  • 3.4. Assignments
• 4. Pickle serialization
  • 4.1. Serializing objects
  • 4.2. Deserialize objects
  • 4.3. Assignments

Database

Database

• 1. DB API
• 2. SQLite
  • 2.1. SQL Syntax
  • 2.2. Connection
  • 2.3. Execute
  • 2.4. Executemany
  • 2.5. Results
  • 2.6. Cursor
  • 2.7. Use cases
  • 2.8. Assignments
• 3. MySQL
  • 3.1. pyMySQL
• 4. PostgreSQL
  • 4.1. psycopg2
• 5. pymongo
  • 5.1. Install
  • 5.2. Insert data
  • 5.3. Select data
• 6. ORM
  • 6.1. SQLAlchemy
  • 6.2. Django ORM
• 7. Database Schema Migration
  • 7.1. SQLAlchemy
  • 7.2. Django
  • 7.3. FlywayDB
  • 7.4. LiquidBase
• 8. Data exploration
  • 8.1. Apache Superset
• 9. SQL Injection
  • 9.1. Prepare query
  • 9.2. Get user input
  • 9.3. Execute query
• 10. SQL
  • 10.1. ACID
  • 10.2. CREATE
  • 10.3. INSERT
  • 10.4. AUTOINCREMENT
  • 10.5. COMMIT and ROLLBACK
  • 10.6. SELECT
  • 10.7. UPDATE
  • 10.8. GROUP BY
  • 10.9. HAVING
  • 10.10. ALTER
  • 10.11. DROP
  • 10.12. DELETE
  • 10.13. JOIN
  • 10.14. TRUNCATE
  • 10.15. SQL Injection

Object Oriented Programming

Object Oriented Programming

• 1. Objects and Classes
  • 1.1. Object Paradigm
  • 1.2. Classes
  • 1.3. Fields
  • 1.4. Initializer Method
  • 1.5. Methods
  • 1.6. Assignments
• 2. OOP Basic
  • 2.1. Access modifiers
  • 2.2. __dict__ - Getting dynamic fields and values
  • 2.3. One class per file?
  • 2.4. Assignments
• 3. Inheritance
  • 3.1. Simple inheritance
  • 3.2. Multilevel Inheritance
  • 3.3. Multiple Inheritance
  • 3.4. Calling parent methods
• 4. Inheritance vs. Composition
  • 4.1. Problem with inheritance
  • 4.2. Multi level inheritance problem
  • 4.3. Composition using Mixin classes
• 5. Static and Dynamic Fields
  • 5.1. Static Fields
  • 5.2. Dynamic Fields
  • 5.3. Static vs. Dynamic Fields
• 6. Stringify objects
  • 6.1. __str__ vs. __repr__
  • 6.2. Print formatting in classes
• 7. OOP Intermediate
  • 7.1. Initial arguments mutability and shared state
  • 7.2. Relations
  • 7.3. Assignments
• 8. Operator Overload
  • 8.1. Why to use operator overload?
  • 8.2. Operator Overload
  • 8.3. Example
  • 8.4. Assignment
• 9. Dataclass
  • 9.1. Syntax
  • 9.2. Example
  • 9.3. __init__ vs. __post_init__
  • 9.4. Field Factory
  • 9.5. Use cases
  • 9.6. More advanced options
  • 9.7. Under the hood
  • 9.8. Assignments
• 10. Enum
  • 10.1. Why?
  • 10.2. Definition
  • 10.3. Accessing names and values
  • 10.4. Iterating over Enum
  • 10.5. Identity check
  • 10.6. Use cases
  • 10.7. Assignments
• 11. Object initialization
  • 11.1. __call__()
  • 11.2. __new__()
  • 11.3. __init__()
  • 11.4. Example usage
  • 11.5. Proxy methods
  • 11.6. Returning values
  • 11.7. Why?
• 12. OOP Paradigm
  • 12.1. Good Engineering Practises
  • 12.2. S.O.L.I.D.
  • 12.3. GRASP
• 13. Interfaces and Abstracts
  • 13.1. Interfaces
  • 13.2. Abstract classes and methods
• 14. Polymorphism
  • 14.1. Switch
  • 14.2. Polymorphism on Function
  • 14.3. Polymorphism on Classes
• 15. Object Identity
  • 15.1. Hash
  • 15.2. is
• 16. Method Resolution Order
  • 16.1. Inheritance Method Resolution
  • 16.2. Inheritance Diamond
• 17. OOP Advanced
  • 17.1. Placeholder class
  • 17.2. Objects and instances
  • 17.3. What should be in the class and what not?
  • 17.4. Assignments
• 18. Dynamic Typing
  • 18.1. Duck typing
  • 18.2. Everything is an object
  • 18.3. Monkey Patching
• 19. Setter, Getter, Deleter
  • 19.1. Accessing class fields using setter and getter
  • 19.2. Accessing class fields using properties
  • 19.3. Dynamically creating fields
  • 19.4. Getter
  • 19.5. Setter
  • 19.6. Deleter
  • 19.7. Accessors
• 20. Slots
  • 20.1. Using
  • 20.2. __slots__ and __dict__
  • 20.3. Inheritance
  • 20.4. More info
• 21. Metaclass
  • 21.1. Metaclass mechanism
  • 21.2. Type and objects
  • 21.3. Example
  • 21.4. Factories
  • 21.5. Metaclass replacements

Protocols

Protocols

• 1. Descriptor
  • 1.1. The Descriptor Protocol
  • 1.2. Builtin Descriptor Object Examples
  • 1.3. Example
  • 1.4. Case Study
  • 1.5. Assignments
• 2. Generators and Comprehensions
  • 2.1. Lazy evaluation
  • 2.2. Generator expressions vs. Comprehensions
  • 2.3. Returning nested objects
  • 2.4. yield Operator
  • 2.5. Example
  • 2.6. Readability counts
  • 2.7. Assignments
• 3. Iterators
  • 3.1. Protocol
  • 3.2. Iterowanie po obiektach
  • 3.3. Own Implementation
  • 3.4. itertools
  • 3.5. Przykład
  • 3.6. Assignments
• 4. Context Managers
  • 4.1. Protocol
  • 4.2. Use Case
  • 4.3. Examples
  • 4.4. Contextmanager decorator
  • 4.5. Assignments
• 5. Decorator
  • 5.1. Definition
  • 5.2. Zastosowanie
  • 5.3. Example
  • 5.4. Class Decorators
  • 5.5. functools
  • 5.6. Przykład
  • 5.7. Assignments

Tests

Tests

• 1. Doctest
  • 1.1. Running tests
  • 1.2. Test for bool return values
  • 1.3. Test numeric return values
  • 1.4. Test for str return values
  • 1.5. Testing for exceptions
  • 1.6. Using python statements in doctest
  • 1.7. Practical example
  • 1.8. Assignments
• 2. Unit Testing
  • 2.1. Glossary
  • 2.2. Using unittest
  • 2.3. Example
  • 2.4. Assignments

Good Engineering Practice

Good Engineering Practice

• 1. Software Engineering Conventions
  • 1.1. PEP 8 - Style Guide for Python Code
  • 1.2. Static Code Analysis
  • 1.3. Assignment
• 2. The Zen of Python
  • 2.1. Most important rules
  • 2.2. Full Text
• 3. Code Smells
  • 3.1. Bad practice
• 4. Type Annotation
  • 4.1. Korzystanie z typów
  • 4.2. Introspekcja
  • 4.3. Sprawdzanie typów
  • 4.4. Dodawanie typów do istniejącego kodu
• 5. ReST and Sphinx documentation
  • 5.1. reStructuredText vs. Markdown
  • 5.2. Format reStructuredText
  • 5.3. Sphinx
  • 5.4. Read the docs
  • 5.5. Assignments

CI/CD

CI/CD

• 1. CI/CD Tools
  • 1.1. Static Analysis
  • 1.2. Security
  • 1.3. Distributing and Packaging
  • 1.4. Code Style and Practices
  • 1.5. Code complexity and Coverage
  • 1.6. Testing
  • 1.7. Type Checking
  • 1.8. Database Schema Migration
• 2. CI/CD Pipelines
  • 2.1. Bitbucket Pipelines
  • 2.2. Travis
• 3. Linters
  • 3.1. pycodestyle
  • 3.2. flake8
  • 3.3. pylint
  • 3.4. pyflakes
  • 3.5. pylama
• 4. Behavioral Testing
  • 4.1. behave
• 5. Code Style
• 6. Code Coverage
• 7. Internationalization
  • 7.1. Translation
• 8. DB Schema Migration
• 9. Distributing
• 10. Security
• 11. Smoke Tests
• 12. Static Code Analysis
  • 12.1. SonarLint
  • 12.2. SonarScanner
  • 12.3. SonarQube
  • 12.4. Przygotowanie środowiska statycznej analizy
• 13. Test Automation
  • 13.1. fabric
  • 13.2. pssh
• 14. Type Checking
  • 14.1. mypy
  • 14.2. pyre-check
  • 14.3. pytypes
• 15. UI testing
  • 15.1. selenium
• 16. Mutation Testing

Debugging

Debugging

• 1. Python WAT?!
• 2. Logging
  • 2.1. Korzystanie z logging
  • 2.2. Konfiguracja formatowania logów
  • 2.3. Further Reading
• 3. Warnings
  • 3.1. Usage
  • 3.2. Running
  • 3.3. Example
• 4. Basic Debugging
  • 4.1. Run in the console
  • 4.2. print
  • 4.3. pprint
  • 4.4. locals()
  • 4.5. Using debugger in IDE
• 5. Advanced Debugging
  • 5.1. json.tool
  • 5.2. Using pdb
  • 5.3. breakpoint()
  • 5.4. Using debugger in IDE
  • 5.5. Debugging i Wątki
  • 5.6. Debugging i Procesy
  • 5.7. Debugging aplikacji sieciowych
  • 5.8. Assignment
• 6. Introspection
  • 6.1. Introspecting Types
  • 6.2. Introspecting Objects
  • 6.3. Introspecting Docstrings
  • 6.4. Example

Distributing

Distributing

• 1. Virtualenv
  • 1.1. Tworzenie wirtualnego środowiska
  • 1.2. Aktywacja i korzystanie ze środowiska
  • 1.3. Dobra praktyka
  • 1.4. Pakiety i zależności
• 2. Standalone Applications
  • 2.1. zipapp
• 3. Distributing Packages
  • 3.1. Instalacja i korzystanie z zewnętrznych bibliotek
  • 3.2. Importowanie modułów
  • 3.3. Modularyzacja
  • 3.4. Tworzenie paczek
  • 3.5. Przyszłość paczkowania i dystrybucji

High Performance

High Performance

• 1. Performance Optimization
  • 1.1. PyPy
  • 1.2. Seven strategies
  • 1.3. Use set instead of list
  • 1.4. Use list.append() instead of str + str
  • 1.5. Range between two float
  • 1.6. Inne
  • 1.7. Further Reading
  • 1.8. Assignments
• 2. Micro-benchmarking
  • 2.1. Evaluation
  • 2.2. timeit
  • 2.3. Use cases
  • 2.4. Summary
  • 2.5. References
• 3. Compilers and interpreters
  • 3.1. Interpreters
  • 3.2. Compiling
• 4. Collections
  • 4.1. OrderedDict
  • 4.2. namedtuple
  • 4.3. collections.Counter
• 5. C Types
  • 5.1. Code
  • 5.2. Build
  • 5.3. Run
  • 5.4. Use cases
  • 5.5. Assignments
• 6. C Modules
  • 6.1. Code
  • 6.2. Compile
  • 6.3. Run
  • 6.4. Assignments

Concurrency

Concurrency

• 1. Queues
  • 1.1. Queue
  • 1.2. queue
• 2. Threads
  • 2.1. Threads vs processes
  • 2.2. Problemy z wątkami
  • 2.3. threading
  • 2.4. Tworzenie wątków
  • 2.5. Synchronizacja wątków
  • 2.6. Zamykanie wątków
  • 2.7. Workery
  • 2.8. Assignments
• 3. Multiprocessing
  • 3.1. Problems
  • 3.2. Cykl życia procesów
  • 3.3. IPC - Inter-Process Communication
• 4. Concurrency
  • 4.1. High-Level Concurrency
  • 4.2. Coroutine
  • 4.3. Asyncio
  • 4.4. Przykłady praktyczne
  • 4.5. Trio
  • 4.6. References

Design Patterns

Design Patterns

• 1. Dependency injection
• 2. Singleton
• 3. Factory
• 4. Gateway
• 5. Callback
• 6. State Machine
• 7. Gang of Four
  • 7.1. Examples
  • 7.2. Structural Design Patterns
  • 7.3. Creational Design Patterns
  • 7.4. Behavioral Design Patterns
  • 7.5. Idiomy języka programowania

Paradigms

Paradigms

• 1. Functional Programming
  • 1.1. Rekurencja
  • 1.2. Lambda - funkcje anonimowe
  • 1.3. Closure
  • 1.4. Monady
  • 1.5. złożenia funkcji
  • 1.6. functools
  • 1.7. Callback
  • 1.8. Assignments
• 2. Event Programming
  • 2.1. Implementation
  • 2.2. Przykład użycia
  • 2.3. Użycie

Operating System

Operating System

• 1. Commandline argument parsing
  • 1.1. argparse
  • 1.2. Example
  • 1.3. docopt
  • 1.4. Assignments
• 2. Operating System
  • 2.1. Bitwise operators
  • 2.2. Accessing Environmental Variables
  • 2.3. Getting filenames and extensions
  • 2.4. Checking OS version
  • 2.5. sys
  • 2.6. os
  • 2.7. subprocess
  • 2.8. tempfile
  • 2.9. io
  • 2.10. configparser
  • 2.11. pathlib
  • 2.12. Running commands in parallel across many hosts
  • 2.13. Passwords and secrets
  • 2.14. Allegro Tipboard
  • 2.15. Assignments

HTTP and Web

HTTP and Web

• 1. HTTP Protocol
  • 1.1. URI vs URL vs URN
  • 1.2. HTTP Methods
  • 1.3. HTTP Statuses
  • 1.4. HTTP Headers
  • 1.5. MIME types
  • 1.6. API Versioning
• 2. HTTP using stdlib
  • 2.1. http.HTTPStatus
  • 2.2. urllib
  • 2.3. http.server
  • 2.4. http.client
  • 2.5. Assignments
• 3. HTTP using requests
  • 3.1. Basic API
  • 3.2. Response
  • 3.3. GET Requests
  • 3.4. POST Requests
  • 3.5. DELETE Requests
  • 3.6. Custom Headers
  • 3.7. Timeout
  • 3.8. Basic Auth
  • 3.9. Requests OAuth
  • 3.10. Assignments
• 4. HTML Scrapping
  • 4.1. BeautifulSoup
  • 4.2. Assignments
• 5. HTTP Frameworks
  • 5.1. atlassian-python-api
  • 5.2. Standard WSGI
  • 5.3. Standard ASGI
  • 5.4. django
  • 5.5. flask
  • 5.6. webapp2
  • 5.7. tornado
• 6. Templates with Jinja2
  • 6.1. Why?
  • 6.2. Syntax
  • 6.3. Example usage
  • 6.4. Method Calls
  • 6.5. Filters
  • 6.6. Assignment tag
  • 6.7. Include
  • 6.8. Conditionals
  • 6.9. Loops
  • 6.10. Blocks
  • 6.11. Cycle
  • 6.12. Base Template
  • 6.13. Import Macros
  • 6.14. i18n Trans
• 7. PaaS - Platform as a Service
  • 7.1. Heroku
  • 7.2. Amazon AWS
  • 7.3. Google App Engine
• 8. SOAP and WSDL
  • 8.1. WSDL
  • 8.2. suds
  • 8.3. zeep
• 9. Asynchronous processing
  • 9.1. ASGI
  • 9.2. Celery
  • 9.3. RabbitMQ

Network Protocols

Network Protocols

• 1. FTP
  • 1.1. Connect to FTP Server (insecure)
  • 1.2. Connect to FTP Server (secure)
  • 1.3. Download file
  • 1.4. Methods
  • 1.5. Assignments
• 2. IMAP
  • 2.1. Connection
  • 2.2. Methods
  • 2.3. Usage
  • 2.4. Case Study for Gmail IMAP
• 3. SMTP
  • 3.1. Send plaintext email
  • 3.2. Send email with attachments
  • 3.3. Secured connection to the SMTP server
  • 3.4. Assignments
• 4. POP3
  • 4.1. Connection
  • 4.2. poplib API
  • 4.3. Retrieve Messages with POP3
• 5. LDAP
  • 5.1. ldap3
• 6. SSH
  • 6.1. paramiko
  • 6.2. pysftp
  • 6.3. fabric
  • 6.4. pssh
• 7. DNS
  • 7.1. dnspython

Network Transport

Network Transport

• 1. OSI Model
  • 1.1. OSI Model
  • 1.2. OSI Layers
• 2. Interfaces
  • 2.1. netifaces
• 3. Routing
  • 3.1. Unicast
  • 3.2. Broadcast
  • 3.3. Multicast
  • 3.4. Anycast
  • 3.5. Geocast
• 4. Socket
  • 4.1. socket
  • 4.2. socketserver
  • 4.3. References
  • 4.4. Assignments
• 5. SSL
  • 5.1. Socket creation
  • 5.2. SSLSocket
  • 5.3. Client-side operation
  • 5.4. Server-side operation
• 6. IPv4/IPv6
  • 6.1. IP
  • 6.2. ipaddress
  • 6.3. netaddr
• 7. TCP/UDP
  • 7.1. UDP
  • 7.2. TCP
• 8. scapy
  • 8.1. Installation
  • 8.2. Running
  • 8.3. Basic usage
  • 8.4. IP packages
  • 8.5. TCP Package
  • 8.6. Ethernet frames
  • 8.7. Sending packets
  • 8.8. Send and Receive
  • 8.9. SYN Scans
  • 8.10. Advanced examples
• 9. 3rd Party Libraries
  • 9.1. Allegro Ralph
  • 9.2. Pcapy and libpcap
  • 9.3. Dpkt
  • 9.4. Scanpy
  • 9.5. Twisted
  • 9.6. Pyro4
• 10. Mini Botnet
  • 10.1. Assignment

Scientific and Engineering

Scientific and Engineering

• 1. Biblioteki w zastosowaniach naukowych i inżynieryjnych
  • 1.1. Środowisko
  • 1.2. Ecosystem
  • 1.3. Biblioteki do obsługi danych
  • 1.4. Wykresy i grafy
  • 1.5. Biblioteki do nauczania maszynowego
  • 1.6. Other
• 2. Zastosowanie naukowe
  • 2.1. Scipy

Numerical Analysis

Numerical Analysis

• 1. Jupyter
  • 1.1. Install
  • 1.2. Run
  • 1.3. Using
  • 1.4. Shortcut keys
  • 1.5. Cells
  • 1.6. Run
  • 1.7. Magic commands
  • 1.8. Kernels
  • 1.9. Functions
  • 1.10. Performance and profiling
  • 1.11. Markdown
  • 1.12. Embedding objects
  • 1.13. Workflow
  • 1.14. Execute terminal commands
  • 1.15. Output to different formats
  • 1.16. Assignments
• 2. Numpy
  • 2.1. Import
  • 2.2. Data Structures
  • 2.3. Functions
  • 2.4. Statistics
  • 2.5. Random numbers
  • 2.6. Polynomial mathematics
  • 2.7. Arrays
  • 2.8. Vector and matrix mathematics
  • 2.9. Matrix
  • 2.10. Linear Algebra
  • 2.11. Euclidean distance
  • 2.12. Assignments
• 3. Pandas Introduction
  • 3.1. TL;DR
  • 3.2. Import and Export
  • 3.3. Workflow
  • 3.4. Display Output
  • 3.5. Vizualization
  • 3.6. Descriptive statistics
  • 3.7. Assignments
• 4. Pandas Series
  • 4.1. Values
  • 4.2. Creating
  • 4.3. Indexes
  • 4.4. Slicing
  • 4.5. Substitute values
  • 4.6. Arithmetic operations
  • 4.7. Assignments
• 5. Pandas DataFrame
  • 5.1. Creating
  • 5.2. Properties
  • 5.3. Slicing
  • 5.4. Filtering
  • 5.5. Selecting Rows
  • 5.6. Accessing values
  • 5.7. Modifying values
  • 5.8. Selecting values
  • 5.9. Sorting
  • 5.10. Statistics
  • 5.11. Grouping
  • 5.12. Aggregations
  • 5.13. Joins
  • 5.14. Practical Example
  • 5.15. Assignments

Data Visualization

Data Visualization

• 1. Matplotlib
  • 1.1. Glossary
  • 1.2. What is matplotlib
  • 1.3. Installing and using matplotlib
  • 1.4. How to understand charts?
  • 1.5. Simple examples
  • 1.6. Labels and Legend
  • 1.7. Basic customizations
  • 1.8. Additional info
  • 1.9. Working with multiple figures and axes
  • 1.10. Working with text
  • 1.11. Logarithmic and other nonlinear axes
  • 1.12. plt.plot() vs ax.plot()
  • 1.13. Assignment
• 2. Matplotlib Pandas
  • 2.1. Visualizing data
• 3. Matplotlib Charts
  • 3.1. Bars
  • 3.2. Histogram
  • 3.3. Scatter plot
  • 3.4. Stack plot
  • 3.5. Pie chart
  • 3.6. Nested Pie Chart
  • 3.7. 3D
  • 3.8. Assignments
• 4. Matplotlib Plot Lifecycle
  • 4.1. A note on the Object-Oriented API vs Pyplot
  • 4.2. Our data
  • 4.3. Getting started
  • 4.4. Controlling the style
  • 4.5. Customizing the plot
  • 4.6. Combining multiple visualizations
  • 4.7. Saving our plot
  • 4.8. Assignment
• 5. Matplotlib Examples
  • 5.1. Gallery
  • 5.2. Matplotlib and Jupyter
  • 5.3. Points
  • 5.4. Line Chart
  • 5.5. Multiple Charts
  • 5.6. Box Chart
  • 5.7. Bars
  • 5.8. Annotate
  • 5.9. Scales
  • 5.10. Pie Chart
  • 5.11. 3D
  • 5.12. Grid
  • 5.13. Legend using pre-defined labels
  • 5.14. Radar Chart
• 6. Plotly
  • 6.1. Installation
  • 6.2. Offline usage
  • 6.3. Jupyter Usage
  • 6.4. Plot Controls & IPython widgets
  • 6.5. Charts
  • 6.6. Time Series
  • 6.7. Two plots
  • 6.8. 3D Plotting
• 7. Bokeh
  • 7.1. Installation
  • 7.2. Download Sample Data
  • 7.3. Charts
• 8. Seaborn
• 9. Generowanie grafów
  • 9.1. PyDotPlus
  • 9.2. Graphviz
• 10. Projektowanie GUI
  • 10.1. Graphical User Interfaces with Tkinter
  • 10.2. Biblioteka Tkinter

Machine Learning

Machine Learning

• 1. Wprowadzenie do statystyki
  • 1.1. Rozkłady
  • 1.2. Podstawowe pojęcia
• 2. Wprowadzenie do Machine Learning
  • 2.1. Czym jest uczenie maszynowe?
  • 2.2. Co trzeba wiedzieć przed rozpoczęciem pracy?
  • 2.3. Ważne pytania przed przystąpieniem do tworzenia algorytmu
  • 2.4. Czyszczenie Danych
  • 2.5. Praca z bibliotekami
  • 2.6. Kategorie algorytmów uczenia maszynowego
• 3. Słowniczek intuicyjny
• 4. Słownik Pojęć
• 5. Datasets
  • 5.1. Skąd wziąć dane testowe?
• 6. Machine Learning Algorithms
  • 6.1. Regression Algorithms
  • 6.2. Instance-based Algorithms
  • 6.3. Regularization Algorithms
  • 6.4. Decision Tree Algorithms
  • 6.5. Bayesian Algorithms
  • 6.6. Clustering Algorithms
  • 6.7. Assoication Rule Learning Algorithms
  • 6.8. Artificial Neural Network Algorithms
  • 6.9. Deep Learning Algorithms
  • 6.10. Dimensional Reduction Algorithms
  • 6.11. Ensemble Algorithms
  • 6.12. Other Algorithms
• 7. Features
  • 7.1. Czym są features?
  • 7.2. Przykład praktyczny
  • 7.3. What Makes a Good Feature?
  • 7.4. Assignments
• 8. Classifiers
  • 8.1. Co to jest Classifier?
  • 8.2. Schemat działania classifiera
• 9. scikit-learn
  • 9.1. Loading Sample Datasets
  • 9.2. Fit and Predict
  • 9.3. Classifier
  • 9.4. Feature Selection
  • 9.5. Evaluation
  • 9.6. Label Encoder
  • 9.7. Writing Own Classifier
  • 9.8. Zadania praktyczne
• 10. Model Quality
  • 10.1. Metody doboru modelu i poprawienia jakości
  • 10.2. Słownictwo
  • 10.3. Diagnostyka Bias vs. Wariancja
  • 10.4. Model Evaluation Procedure
  • 10.5. Regularyzacja
  • 10.6. Random Forrest
  • 10.7. Ensemble averaging
• 11. Decision Tree
  • 11.1. Visualizing a Decision Tree
  • 11.2. Zadania praktyczne
• 12. k Nearest Neighbors
  • 12.1. Jak działa algorytm "K najbliższych sąsiadów"
  • 12.2. Przykład praktyczny
  • 12.3. Określanie przynależności do zbioru
  • 12.4. Wyznaczanie odległości
  • 12.5. Zalety i wady
  • 12.6. Assignments
• 13. Bayes
  • 13.1. Co to jest Naiwny klasyfikator Bayesowski?
  • 13.2. Gaussian Naive Bayes
  • 13.3. Przykłady praktyczne
  • 13.4. Plusy i minusy Naiwnego Bayesa
  • 13.5. Aplikacje Naiwnego klasyfikatora Bayesa
  • 13.6. Przykłady praktyczne
  • 13.7. Zadanie kontrolne
• 14. Linear Regression
  • 14.1. Co to jest Linear Regression?
  • 14.2. Przed zastosowaniem
  • 14.3. Wyznaczanie równania prostej
  • 14.4. Funkcja przedziałami liniowa
  • 14.5. Przykłady praktyczne
  • 14.6. Assignments
• 15. Logistic Regression
  • 15.1. Co to jest Logistic Regression?
  • 15.2. Linear vs Logistics
  • 15.3. Podstawowe pojęcia
  • 15.4. Przykład zastosowania
  • 15.5. Assignments
• 16. Support Vector Machines
  • 16.1. TL;DR
  • 16.2. Charakterystyka algorytmu
  • 16.3. Opis algorytmu
  • 16.4. Support Vector Machines (Kernels)
  • 16.5. Przykłady praktyczne
  • 16.6. Assignments
  • 16.7. Lektura uzupełniająca
• 17. Clustering
  • 17.1. Przykłady zastosowania
  • 17.2. Algorytmy klastrowania
  • 17.3. Flat Clustering
  • 17.4. Hierarchical Clustering
  • 17.5. Porównanie algorytmów
  • 17.6. Przykład praktyczny
  • 17.7. Assignments
• 18. Principal Component Analysis (PCA)
  • 18.1. What is Principal Component Analysis?
  • 18.2. 2D example
  • 18.3. 3D example
  • 18.4. Przykłady praktyczne
  • 18.5. Assignments
• 19. Neural Network
  • 19.1. What Is a Neural Network?
  • 19.2. Słownictwo
  • 19.3. Przykład praktyczny
  • 19.4. Tools
  • 19.5. Działanie na sieciach neuronowych
  • 19.6. Przetwarzanie obrazów na przykładzie rozpoznawania odręcznie napisanych cyfr (MNIST)
  • 19.7. Przykłady praktyczne
  • 19.8. Assignments
• 20. Convolutional Neural Network
  • 20.1. Problemy z przetwarzaniem obrazów
  • 20.2. What is and Kernel Convolution?
  • 20.3. What is Convolutional Neural Network (CNN / ConvNet)
  • 20.4. Przydatne odnośniki
• 21. Przydatne odnośniki
  • 21.1. Neural Networks
  • 21.2. Understanding the Bias-Variance Tradeoff
  • 21.3. Bayes
  • 21.4. PyMC3
  • 21.5. Inne
• 22. Notes
  • 22.1. Program
  • 22.2. Program 2
  • 22.3. Notatki
  • 22.4. Data Science
  • 22.5. Jupyter
  • 22.6. Machine Learning
  • 22.7. Metody bez nadzoru

Django

Django

• 1. HTTP
  • 1.1. Narzędzia
  • 1.2. DNS
  • 1.3. HTTP Protocol
  • 1.4. HTTP Methods
  • 1.5. HTML + JS + CSS
• 2. Introduction to Django
  • 2.1. Co to jest Django?
  • 2.2. Dokumentacja
  • 2.3. Wersjonowanie
  • 2.4. setup.cfg
  • 2.5. IDE Support
• 3. Django Framework Architecture
  • 3.1. Framework Architecture
  • 3.2. Request-Response flow
• 4. Installation and Running
  • 4.1. Instalacja
  • 4.2. Starting new project
  • 4.3. IDE Run configuration
• 5. Settings
• 6. Apps
  • 6.1. Reusability
  • 6.2. Location
  • 6.3. Create
  • 6.4. Structure
  • 6.5. Configuration
• 7. Models
  • 7.1. Model Fields
  • 7.2. Model field arguments
  • 7.3. Abstract Models
  • 7.4. Architecture
  • 7.5. Single File vs. Models per file
  • 7.6. Reverse engineering database
  • 7.7. Database schema migration
  • 7.8. Example Model
  • 7.9. Assignments
• 8. URL Router
  • 8.1. Global URLs
  • 8.2. In app URLs
  • 8.3. urlpatterns
  • 8.4. path
  • 8.5. url
  • 8.6. include
  • 8.7. URLs reversing
  • 8.8. URLs in templates
• 9. ORM
  • 9.1. QuerySet
  • 9.2. Field lookups
  • 9.3. Filters can reference fields on the model
  • 9.4. Complex lookups with Q objects
  • 9.5. Comparing objects
  • 9.6. Q() expressions
  • 9.7. F() expressions
  • 9.8. Aggregations
• 10. Views
  • 10.1. Class Based Views
  • 10.2. Generic Views
  • 10.3. Responses
  • 10.4. Permissions in Views
• 11. Forms
  • 11.1. Forms
  • 11.2. Model Forms
  • 11.3. Widgets
• 12. REST
  • 12.1. RESTful Views
  • 12.2. python -m json.tool
  • 12.3. django-rest-framework
  • 12.4. django-rest-swagger
• 13. Staticfiles
  • 13.1. Settings
  • 13.2. Serving staticfiles
• 14. Templates
• 15. Templatetags
  • 15.1. Filters
  • 15.2. Simple Tags
  • 15.3. Assignment tags
  • 15.4. Block tags
• 16. Admin panel
  • 16.1. Customizong
  • 16.2. Permissions
  • 16.3. Model Admin
  • 16.4. Model Inlines
  • 16.5. Extending Admin
  • 16.6. ModelAdmin Example
  • 16.7. django-import-export
  • 16.8. Grapelli
• 17. Management Commands
  • 17.1. Built-in
  • 17.2. Writing own management commands
• 18. i18n and l10n
  • 18.1. Timezone
  • 18.2. i18n - internationalization
• 19. Database
  • 19.1. Database schema migration
  • 19.2. Management commands
  • 19.3. Database settings
  • 19.4. Fixtures
  • 19.5. Multiple DB and db routing
• 20. Cache
• 21. Signals
  • 21.1. Available signals
  • 21.2. Examples
• 22. Auth and Permissions
  • 22.1. Basic Auth
  • 22.2. Require Permissions
• 23. API CORS
• 24. Standalone scripts
• 25. Tests and quality
  • 25.1. Tests
  • 25.2. Test URLs
  • 25.3. SonarQube
  • 25.4. Debug Toolbar
• 26. Tests
• 27. CI/CD - Continuous Integration and Deployment
  • 27.1. Bitbucket Pipelines
  • 27.2. Travis
• 28. Deployment
  • 28.1. Deployment platforms
  • 28.2. Packaging
  • 28.3. Staticfils serving

Blogposts

Blogposts

• 1. Wprowadzenie do Machine Learning w Pythonie
  • 1.1. Czym jest uczenie maszynowe?
  • 1.2. Co trzeba wiedzieć przed rozpoczęciem pracy?
  • 1.3. Ważne pytania przed przystąpieniem do tworzenia algorytmu
  • 1.4. Czyszczenie Danych
  • 1.5. Praca z bibliotekami
  • 1.6. Kategorie algorytmów uczenia maszynowego

Workshop

Appendixes

Appendixes

• 1. History
  • 1.1. BDFL - Guido van Rossum
  • 1.2. Name
  • 1.3. PSF - Python Software Foundation
• 2. Further reading
  • 2.1. My favourite sources
  • 2.2. Documentation
  • 2.3. Working with Excel
  • 2.4. IDE - Integrated Development Environment
  • 2.5. Others
  • 2.6. IT Fun
  • 2.7. Wyzwania i potyczki
• 3. Books
  • 3.1. Algorithms
  • 3.2. Databases
  • 3.3. Software Engineering Practises
  • 3.4. Design patterns
  • 3.5. Refactoring
  • 3.6. Python
• 4. Video
  • 4.1. Collections of videos
  • 4.2. Python
  • 4.3. Machine Learning and Data Science
  • 4.4. Filmy z ostatnich konferencji
• 5. Python 2 vs. 3
  • 5.1. six
  • 5.2. Lista kompatybilności Python 2 i Python 3
  • 5.3. Unicode i kodowanie znaków
  • 5.4. Biblioteki standardowe w 2 i 3
• 6. References
  • 6.1. Bibliography
  • 6.2. Images
  • 6.3. Video
• 7. Copyright
  • 7.1. MIT License