Python 3: from None to Machine Learning

Tip

The most up-to-date version of this book is always at http://python.astrotech.io

Author

name:Matt Harasymczuk email:matt@astrotech.io www:http://www.astrotech.io github:https://github.com/astromatt linkedin:https://linkedin.com/in/mattharasymczuk facebook:https://facebook.com/matt.harasymczuk slideshare:https://www.slideshare.net/astrotech/presentations

Tab. 1. Other books from author

URL	Title
http://python.astrotech.io	Python 3 and Machine Learning
http://devops.astrotech.io	DevOps and CI/CD wtih Docker
http://jira.astrotech.io	Jira Software, Jira Service Desk and Jira Core
http://git.astrotech.io	GIT and GIT Flow
http://agile.astrotech.io	Agile, Scrum, Kanban, XP, Lean
http://arch.astrotech.io	Software Architecture, Cloud, Microservices and Processes
http://linux.astrotech.io	Linux and Shell Programming with Bash

Tip

If you’re interested in training course on topics from this book, please email me at matt@astrotech.io

Workshop

Warning

Before training course please setup your environment as described here Installing Python.

• Python Foundations
• Python Intermediate
• Python Advanced
• Django Framework
• Python in Networking
• Python in Testing
• Python in Science and Engineering
• Python in Machine Learning

Introduction

Introduction

• 1. Installing Python
  • 1.1. System Requirements
  • 1.2. Setting-up Environment
• 2. References in the book
  • 2.1. Iris Dataset
  • 2.2. Ehlo World!
  • 2.3. Addresses
  • 2.4. Dates and timezones
  • 2.5. Main Characters
• 3. About Python Language
  • 3.1. What is Python?
  • 3.2. Which version?
  • 3.3. Scripts
  • 3.4. Python Console (REPL)
  • 3.5. Jupyter
• 4. IDE - Integrated Development Environment
  • 4.1. What is IDE?
  • 4.2. How to choose?
  • 4.3. Which one is the best?
  • 4.4. PyCharm
  • 4.5. Assignments
• 5. Syntax
  • 5.1. Indentation instead of braces
  • 5.2. End of lines
  • 5.3. Comments
  • 5.4. Variables and constants
  • 5.5. print()
  • 5.6. Assignments

Data Types

Data Types

• 1. int
  • 1.1. Defining int
  • 1.2. Converting to int
  • 1.3. Numerical Operators
• 2. float
  • 2.1. Defining float
  • 2.2. Converting to float
  • 2.3. Numeric Functions
  • 2.4. Assignments
• 3. bool
  • 3.1. Defining bool
  • 3.2. Converting to bool
  • 3.3. Negative values
  • 3.4. Boolean logic
  • 3.5. Logic operators
  • 3.6. Assignments
• 4. None
  • 4.1. Defining None
  • 4.2. Assignments
• 5. str
  • 5.1. Defining str
  • 5.2. Type casting to str
  • 5.3. Single or double quote?
  • 5.4. Escape characters
  • 5.5. Characters before strings
  • 5.6. String methods
  • 5.7. Getting text from user
  • 5.8. Cleaning str from user input
  • 5.9. Assignments
• 6. list
  • 6.1. Defining list
  • 6.2. Adding elements
  • 6.3. Slicing list
  • 6.4. sorted() vs. list.sort()
  • 6.5. Built-in functions on sequences
  • 6.6. Membership Operators
  • 6.7. Length of a list
• 7. set
  • 7.1. Defining set
  • 7.2. Adding items
  • 7.3. set arithmetics
  • 7.4. Slicing set
  • 7.5. Length of a set
  • 7.6. Converting list to set deduplicate items
• 8. tuple
  • 8.1. Defining tuple
  • 8.2. Slicing tuple
  • 8.3. Length of a tuple
• 9. dict
  • 9.1. Defining dict
  • 9.2. Adding elements
  • 9.3. Accessing elements
  • 9.4. Length of a dict
  • 9.5. Assignments
• 1. Nested Collections
  • 1.1. list of tuple
  • 1.2. list of dict
  • 1.3. list of list
  • 1.4. Mixed types
  • 1.5. Assignments
• 10. Type System
  • 10.1. Type inference
  • 10.2. Type Hinting A.K.A. Type Annotation
  • 10.3. Problematic types

Control Flow

Control Flow

• 1. Slicing
  • 1.1. Accessing element with index
  • 1.2. Accessing range of elements
  • 1.3. Slice function
  • 1.4. Reversing and stepping over elements
  • 1.5. Assignments
• 2. Unpacking sequences
  • 2.1. Unpacking values
  • 2.2. Unpacking arbitrary number of arguments
  • 2.3. More advanced topics
  • 2.4. Assignments
• 1. Conditional Statements
  • 1.1. if
  • 1.2. else
  • 1.3. Inline if
  • 1.4. elif and switch
  • 1.5. Assignments
• 3. Composite statements
  • 3.1. Complex expressions
  • 3.2. Control Statements
  • 3.3. Assignments
• 2. Operators
  • 2.1. Operator precedence
  • 2.2. Assignments
• 4. While loop
  • 4.1. Declaration
  • 4.2. break and continue
  • 4.3. Assignments
• 5. for loop
  • 5.1. Syntax
  • 5.2. Iterating over str
  • 5.3. Iterating simple collections
  • 5.4. Assignments
• 6. Loops and nested objects
  • 6.1. Iterating over nested list items
  • 6.2. Unpacking values in loop
  • 6.3. Enumerating and item index
  • 6.4. Iterating over dict items
  • 6.5. Iterating complex types
  • 6.6. Assignments
• 3. Comprehensions
  • 3.1. Simple usage
  • 3.2. Conditional Comprehension
  • 3.3. Why?
  • 3.4. Advanced usage for Comprehensions and Generators
  • 3.5. Assignments
• 4. Exceptions
  • 4.1. What are and why to use exceptions?
  • 4.2. Most common exceptions
  • 4.3. Raising exceptions
  • 4.4. Tracebacks
  • 4.5. Catching exceptions
  • 4.6. Exception hierarchy
  • 4.7. Defining own exceptions
  • 4.8. Real life use-case
• 5. Files
  • 5.1. Path
  • 5.2. Access modes
  • 5.3. Read from file
  • 5.4. Writing to file
  • 5.5. Appending to file
  • 5.6. Exception handling
  • 5.7. Good Engineering Practises
  • 5.8. Assignments
• 6. Exam from basic topics
  • 6.1. Parsowanie /etc/passwd

Functions

Functions

• 1. Function Basics
  • 1.1. Function definition
  • 1.2. Returning values
  • 1.3. Function arguments
  • 1.4. Naming convention
  • 1.5. Variable scope
  • 1.6. More advanced topics
  • 1.7. Assignments
• 1. Unpacking return elements
  • 1.1. * and ** operators
  • 1.2. Unpacking values from function
  • 1.3. Example
  • 1.4. Assignments
• 2. Functions with many arguments
  • 2.1. Operands * and **
  • 2.2. Recap information about function parameters
  • 2.3. Defining function with many arguments
  • 2.4. Case Study
  • 2.5. Assignment
• 3. Passing many arguments
  • 3.1. Operators * i **
  • 3.2. * unpacks list or tuple
  • 3.3. ** unpacks dict
  • 3.4. Przekazywanie do funkcji zmiennej ilości parametrów
  • 3.5. Przykładowe zastosowanie
  • 3.6. Assignments
• 4. Recurrence
  • 4.1. What is recurrence?
• 2. Advanced Functions
  • 2.1. Type annotations
  • 2.2. Callable
  • 2.3. Assignments

Standard Library

Standard Library

• 1. Installing Packages
  • 1.1. Virtualenv
  • 1.2. Searching
  • 1.3. Installing
  • 1.4. Using
  • 1.5. Importing
  • 1.6. Assignments
• 2. Builtin and Keywords
  • 2.1. Keywords
  • 2.2. Builtin functions
  • 2.3. Other builtin functions
  • 2.4. Assignments
• 3. Mathematics
  • 3.1. complex
  • 3.2. Builtin
  • 3.3. math
  • 3.4. fractions
  • 3.5. statistics
  • 3.6. random
  • 3.7. collections.Counter
  • 3.8. matplotlib
  • 3.9. Assignments
• 1. Numerical Precision
  • 1.1. Problem
  • 1.2. float anatomy
  • 1.3. decimal
• 4. Print Formatting
  • 4.1. Funkcja print
  • 4.2. Konkatenacja stringów
  • 4.3. Interpolacja zmiennych
  • 4.4. Metoda .format()
  • 4.5. f-strings - Python >= 3.6
  • 4.6. SQL Injection
  • 4.7. PEP 3101 – Advanced String Formatting
  • 4.8. Więcej informacji
  • 4.9. pprint
  • 4.10. Assignments
• 5. Regular Expressions
  • 5.1. Constructing Regular Expressions
  • 5.2. Most frequent used functions in re module
  • 5.3. RegEx parameters (variables)
  • 5.4. Multi line searches
  • 5.5. Greedy and non-greedy search
  • 5.6. Practical example of Regex usage
  • 5.7. Assignments

Date and Time

Date and Time

• 1. Dates and Time
  • 1.1. Creating date objects
  • 1.2. Creating time objects
  • 1.3. Creating datetime objects
  • 1.4. datetime methods
  • 1.5. Assignments
• 2. Parsing and Formatting
  • 2.1. Date and time formats
  • 2.2. ISO 8601 Standard
  • 2.3. Table of date and time parsing and formatting parameters
  • 2.4. f-string formatting
  • 2.5. Format to string
  • 2.6. Parsing dates
  • 2.7. Assignments
• 3. Time Deltas
  • 3.1. Time shifts
  • 3.2. timedelta
  • 3.3. Time diff
  • 3.4. Assignments
• 4. Timezones
  • 4.1. Time zones in datetime library
  • 4.2. pytz
• 5. Timestamp
  • 5.1. datetime
  • 5.2. time
• 6. Time Utils
  • 6.1. Sleep
  • 6.2. calendar
  • 6.3. timeit - Microbenchmarks

Serialization

Serialization

• 1. CSV Serialization
  • 1.1. Reading data from CSV files
  • 1.2. Writing to CSV files
  • 1.3. Parsing non-CSV files with csv.DictReader()
  • 1.4. Assignments
• 2. JSON Serialization
  • 2.1. JSON syntax
  • 2.2. JSON Serialization of simple objects
  • 2.3. Serializing datetime and date
  • 2.4. Class based encoders and decoders
  • 2.5. Serializing objects
  • 2.6. Pretty Printing JSON
  • 2.7. Assignments
• 3. XML
  • 3.1. xml
  • 3.2. lxml
  • 3.3. xslt
  • 3.4. Assignments
• 4. Pickle serialization
  • 4.1. Serializing objects
  • 4.2. Deserializing objects
  • 4.3. Assignments
• 1. Databases
  • 1.1. SQL Syntax
  • 1.2. DB API
  • 1.3. sqlite3
  • 1.4. pyMySQL
  • 1.5. psycopg2
  • 1.6. pymongo
  • 1.7. SQL Injection
  • 1.8. ORM
  • 1.9. Database Schema Migration
  • 1.10. Data exploration
  • 1.11. Case Study
  • 1.12. Assignments
• 2. SQL
  • 2.1. ACID
  • 2.2. Data Types
  • 2.3. Constrains
  • 2.4. CREATE
  • 2.5. INSERT
  • 2.6. AUTOINCREMENT
  • 2.7. COMMIT and ROLLBACK
  • 2.8. SELECT
  • 2.9. UPDATE
  • 2.10. GROUP BY
  • 2.11. HAVING
  • 2.12. ALTER
  • 2.13. DROP
  • 2.14. DELETE
  • 2.15. JOIN
  • 2.16. TRUNCATE
  • 2.17. SQL Injection

Object Oriented Programming

Object Oriented Programming

• 1. OOP Basic
  • 1.1. Object Paradigm
  • 1.2. Classes
  • 1.3. Classes vs Objects
  • 1.4. Fields
  • 1.5. Methods
  • 1.6. Initializer Method
  • 1.7. Stringify object
  • 1.8. One class per file?
  • 1.9. Assignments
• 2. OOP Intermediate
  • 2.1. Fields
  • 2.2. Initial arguments mutability and shared state
  • 2.3. Inheritance
  • 2.4. More advanced topics
  • 2.5. Assignments
• 3. Dataclass
  • 3.1. Example 1
  • 3.2. Field Factory
  • 3.3. __init__ vs. __post_init__
  • 3.4. Case Study
  • 3.5. More advanced options
  • 3.6. Under the hood
  • 3.7. Assignments
• 4. Enum
  • 4.1. Why?
  • 4.2. Definition
  • 4.3. Usage
  • 4.4. Case Study
  • 4.5. Assignments
• 5. Operator Overload
  • 5.1. Why to use operator overload?
  • 5.2. Numerical Operator Overload
  • 5.3. Logical Operator Overload
  • 5.4. Boolean Operator Overload
  • 5.5. Builtins Function Overload
  • 5.6. Accessors Overload
  • 5.7. Assignment
• 1. OOP Paradigm
  • 1.1. Everything is an object
  • 1.2. Duck typing
  • 1.3. Private, protected, public?!
  • 1.4. Inheritance vs. Composition (Mixin Classes)
  • 1.5. Polymorphism
  • 1.6. Interfaces
  • 1.7. Abstract Classes
  • 1.8. Good Engineering Practises
  • 1.9. S.O.L.I.D.
  • 1.10. GRASP
  • 1.11. Dependency injection
• 2. OOP Advanced
  • 2.1. __str__() and __repr__()
  • 2.2. What should be in the class and what not?
  • 2.3. Dynamically creating fields
  • 2.4. Setter and Getter
  • 2.5. Hash
  • 2.6. is
  • 2.7. Monkey Patching
  • 2.8. Method Resolution Order
  • 2.9. Objects and instances
  • 2.10. Metaclass
  • 2.11. Assignments
• 3. Metaclass

Good Engineering Practice

Good Engineering Practice

• 1. Software Engineering Conventions
  • 1.1. PEP 8 - Style Guide for Python Code
  • 1.2. PEP 20 - The Zen of Python
  • 1.3. Magic number i magic string
  • 1.4. pycodestyle
  • 1.5. Assignment
• 2. Logging
  • 2.1. Korzystanie z logging
  • 2.2. Konfiguracja formatowania logów
  • 2.3. Further Reading
• 3. Warnings
  • 3.1. Usage
  • 3.2. Running
  • 3.3. Example
• 4. Basic Debugging
  • 4.1. Run in the console
  • 4.2. print
  • 4.3. pprint
  • 4.4. locals()
  • 4.5. Using debugger in IDE
• 5. Doctest
  • 5.1. Test for bool return values
  • 5.2. Test for int return values
  • 5.3. Test for str return values
  • 5.4. Testing for exceptions
  • 5.5. Using python statements in doctest
  • 5.6. Running doctest from standalone scripts
  • 5.7. Practical example
  • 5.8. Assignments
• 6. Unittesting
  • 6.1. Glossary
  • 6.2. Using unittest
  • 6.3. Assignments
• 7. Introspection
  • 7.1. Introspecting Types
  • 7.2. Introspecting Objects
  • 7.3. Introspecting Docstrings
  • 7.4. Example

Design Patterns

Design Patterns

• 1. Generators and Comprehensions
  • 1.1. Lazy evaluation
  • 1.2. Generator expressions vs. Comprehensions
  • 1.3. Operator yield
  • 1.4. The whys and wherefores
  • 1.5. Assignments
• 2. Iterators
  • 2.1. What is iterator?
  • 2.2. Iterowanie po obiektach
  • 2.3. Własny iterator
  • 2.4. itertools
  • 2.5. Przykład
  • 2.6. Assignments
• 3. Context Managers
  • 3.1. About Context Managers
  • 3.2. Contextmanager decorator
  • 3.3. Assignments
• 4. Descriptor
  • 4.1. The Descriptor Protocol
  • 4.2. Builtin Descriptor Object Examples
  • 4.3. Example
  • 4.4. Accessors
  • 4.5. Assignments
• 5. Decorator
  • 5.1. Example
  • 5.2. Zastosowanie
  • 5.3. Function Decorators
  • 5.4. Class Decorators
  • 5.5. functools
  • 5.6. Przykład
  • 5.7. Assignments
• 6. Gang of Four
  • 6.1. Examples
  • 6.2. Structural Design Patterns
  • 6.3. Creational Design Patterns
  • 6.4. Behavioral Design Patterns
  • 6.5. Idiomy języka programowania

HTTP and Web

HTTP and Web

• 3. HTTP Protocol
  • 3.1. HTTP Methods
  • 3.2. HTTP Statuses
  • 3.3. HTTP Headers
  • 3.4. MIME types
  • 3.5. API Versioning
• 4. HTTP using stdlib
  • 4.1. http.HTTPStatus
  • 4.2. urllib
  • 4.3. http.server
  • 4.4. http.client
  • 4.5. Assignments
• 5. HTTP using requests
  • 5.1. Basic API
  • 5.2. Response
  • 5.3. GET Requests
  • 5.4. POST Requests
  • 5.5. DELETE Requests
  • 5.6. Custom Headers
  • 5.7. Timeout
  • 5.8. Basic Auth
  • 5.9. Requests OAuth
  • 5.10. Assignments
• 6. HTML Scrapping
  • 6.1. BeautifulSoup
  • 6.2. Assignments
• 7. HTTP Frameworks
  • 7.1. atlassian-python-api
  • 7.2. Standard WSGI
  • 7.3. django
  • 7.4. flask
  • 7.5. webapp2
  • 7.6. tornado
• 8. Templates with Jinja2
  • 8.1. Why?
  • 8.2. Syntax
  • 8.3. Example usage
  • 8.4. Method Calls
  • 8.5. Filters
  • 8.6. Assignment tag
  • 8.7. Include
  • 8.8. Conditionals
  • 8.9. Loops
  • 8.10. Blocks
  • 8.11. Cycle
  • 8.12. Base Template
  • 8.13. Import Macros
  • 8.14. i18n Trans
• 9. PaaS - Platform as a Service
  • 9.1. Heroku
  • 9.2. Amazon AWS
  • 9.3. Google App Engine
• 10. SOAP and WSDL
  • 10.1. WSDL
  • 10.2. suds

Network

Network and HTTP

• 1. FTP
  • 1.1. Connect to FTP Server (insecure)
  • 1.2. Connect to FTP Server (secure)
  • 1.3. Download file
  • 1.4. Methods
• 2. IMAP
  • 2.1. Connection
  • 2.2. Methods
  • 2.3. Usage
  • 2.4. Case Study for Gmail IMAP
• 3. SMTP
  • 3.1. Send plaintext email
  • 3.2. Send email with attachments
  • 3.3. Secured connection to the SMTP server
• 4. POP3
  • 4.1. Connection
  • 4.2. poplib API
  • 4.3. Retrieve Messages with POP3
• 5. LDAP
  • 5.1. ldap3
• 6. DNS Protocol
  • 6.1. dnspython
• 7. SSH Protocol
  • 7.1. paramiko
  • 7.2. fabric
  • 7.3. pssh
• 8. Interfaces
  • 8.1. netifaces
• 9. IPv4/IPv6
  • 9.1. ipaddress (stdlib)
  • 9.2. netaddr (3rd party)
• 10. TCP/UDP
  • 10.1. TCP
  • 10.2. scapy
• 11. Socket
  • 11.1. socket
  • 11.2. socketserver
  • 11.3. References
• 12. SSL
  • 12.1. Socket creation
  • 12.2. SSLSocket
  • 12.3. Client-side operation
  • 12.4. Server-side operation
• 13. 3rd Party Libraries
  • 13.1. Allegro Ralph
  • 13.2. Pcapy and libpcap
  • 13.3. Dpkt
  • 13.4. Scanpy
  • 13.5. Twisted
  • 13.6. Pyro4
  • 13.7. Celery
  • 13.8. RabbitMQ
• 14. Mini Botnet
  • 14.1. Assignment

CI/CD, Versioning and Distributing

CI/CD, Versioning and Distributing

• 1. Tools for CI/CD
  • 1.1. Frontend Testing
  • 1.2. Static Code Analysis
  • 1.3. Przygotowanie środowiska statycznej analizy
  • 1.4. Behavioral Testing
  • 1.5. Type Checking
  • 1.6. Automation and Releases
  • 1.7. Testy Mutacyjne
  • 1.8. Translation
• 2. Type Annotation
  • 2.1. Sprawdzanie typów
  • 2.2. Dodawanie typów do instniejącego kodu
  • 2.3. Korzystanie z typów
  • 2.4. Introspekcja
• 3. Virtualenv
  • 3.1. Tworzenie wirtualnego środowiska
  • 3.2. Aktywacja i korzystanie ze środowiska
  • 3.3. Dobra praktyka
  • 3.4. Pakiety i zależności
• 4. Standalone Applications
  • 4.1. zipapp
• 5. Distributing Packages
  • 5.1. Instalacja i korzystanie z zewnętrznych bibliotek
  • 5.2. Importowanie modułów
  • 5.3. Modularyzacja
  • 5.4. Tworzenie paczek
  • 5.5. Przyszłość paczkowania i dystrybucji
• 6. Commandline argument parsing
  • 6.1. argparse
  • 6.2. Example
  • 6.3. docopt
  • 6.4. Assignments
• 7. Operating System
  • 7.1. Bitwise operators
  • 7.2. Accessing Environmental Variables
  • 7.3. Getting filenames and extensions
  • 7.4. Checking OS version
  • 7.5. sys
  • 7.6. os
  • 7.7. subprocess
  • 7.8. tempfile
  • 7.9. io
  • 7.10. configparser
  • 7.11. pathlib
  • 7.12. Running commands in parallel across many hosts
  • 7.13. Passwords and secrets
  • 7.14. Allegro Tipboard
  • 7.15. Assignments
• 8. ReST and Sphinx documentation
  • 8.1. reStructuredText vs. Markdown
  • 8.2. Format reStructuredText
  • 8.3. Sphinx
  • 8.4. Read the docs
  • 8.5. Assignments

High Performance

High Performance

• 1. Performance Optimization
  • 1.1. PyPy
  • 1.2. Seven strategies
  • 1.3. Use set instead of list
  • 1.4. Use list.append() instead of str + str
  • 1.5. Range between two float
  • 1.6. Inne
  • 1.7. Further Reading
  • 1.8. Assignments
• 2. Compilers and interpreters
  • 2.1. Interpreters
  • 2.2. Compiling
• 3. Collections
  • 3.1. OrderedDict
  • 3.2. namedtuple
• 4. Queues, Threads and Processes
  • 4.1. Kolejki - Queue
  • 4.2. Threads vs processes
  • 4.3. Threads
  • 4.4. Processes
  • 4.5. Assignments
• 5. Concurrency
  • 5.1. High-Level Concurrency
  • 5.2. Coroutine
  • 5.3. Asyncio
  • 5.4. Przykłady praktyczne
  • 5.5. Trio
• 6. C Extensions
  • 6.1. C Types
  • 6.2. C Modules
  • 6.3. Assignments
• 7. Functional Programming
  • 7.1. Rekurencja
  • 7.2. Lambda - funkcje anonimowe
  • 7.3. Closure
  • 7.4. Monady
  • 7.5. złożenia funkcji
  • 7.6. functools
  • 7.7. Callback
  • 7.8. Assignments
• 8. Advanced Debugging
  • 8.1. json.tool
  • 8.2. Using pdb
  • 8.3. breakpoint()
  • 8.4. Using debugger in IDE
  • 8.5. Debugging i Wątki
  • 8.6. Debugging i Procesy
  • 8.7. Debugging aplikacji sieciowych
  • 8.8. Assignment

Scientific and Engineering

Scientific and Engineering

• 1. Biblioteki w zastosowaniach naukowych i inżynieryjnych
  • 1.1. Środowisko
  • 1.2. Ecosystem
  • 1.3. Biblioteki do obsługi danych
  • 1.4. Wykresy i grafy
  • 1.5. Biblioteki do nauczania maszynowego
  • 1.6. Other
• 4. Zastosowanie naukowe
  • 4.1. Scipy

Numerical Analysis

Numerical Analysis

• 2. Jupyter
  • 2.1. Install
  • 2.2. Run
  • 2.3. Using
  • 2.4. Shortcut keys
  • 2.5. Cells
  • 2.6. Run
  • 2.7. Magic commands
  • 2.8. Kernels
  • 2.9. Functions
  • 2.10. Performance and profiling
  • 2.11. Markdown
  • 2.12. Embedding objects
  • 2.13. Workflow
  • 2.14. Execute terminal commands
  • 2.15. Output to different formats
  • 2.16. Assignments
• 3. Numpy
  • 3.1. Import
  • 3.2. Functions
  • 3.3. Random numbers
  • 3.4. Polynomials
  • 3.5. Arrays
  • 3.6. Statistics
  • 3.7. Vector and matrix mathematics
  • 3.8. Matrix
  • 3.9. Linear Algebra
  • 3.10. Assignments
• 1. Numpy
  • 1.1. Import
  • 1.2. Data Structures
  • 1.3. Functions
  • 1.4. Statistics
  • 1.5. Random numbers
  • 1.6. Polynomial mathematics
  • 1.7. Arrays
  • 1.8. Vector and matrix mathematics
  • 1.9. Matrix
  • 1.10. Linear Algebra
  • 1.11. Euclidean distance
  • 1.12. Assignments
• 2. Pandas Introduction
  • 2.1. TL;DR
  • 2.2. Import and Export
  • 2.3. Workflow
  • 2.4. Display Output
  • 2.5. Vizualization
  • 2.6. Descriptive statistics
  • 2.7. Assignments
• 3. Pandas Series
  • 3.1. Values
  • 3.2. Creating
  • 3.3. Indexes
  • 3.4. Slicing
  • 3.5. Substitute values
  • 3.6. Arithmetic operations
  • 3.7. Assignments
• 4. Pandas DataFrame
  • 4.1. Creating
  • 4.2. Properties
  • 4.3. Slicing
  • 4.4. Filtering
  • 4.5. Selecting Rows
  • 4.6. Accessing values
  • 4.7. Modifying values
  • 4.8. Selecting values
  • 4.9. Sorting
  • 4.10. Statistics
  • 4.11. Grouping
  • 4.12. Aggregations
  • 4.13. Joins
  • 4.14. Practical Example
  • 4.15. Assignments

Data Vizualization

Data Vizualization

• 1. Matplotlib
  • 1.1. Glossary
  • 1.2. What is matplotlib
  • 1.3. Installing and using matplotlib
  • 1.4. How to understand charts?
  • 1.5. Simple examples
  • 1.6. Labels and Legend
  • 1.7. Basic customizations
  • 1.8. Additional info
  • 1.9. Working with multiple figures and axes
  • 1.10. Working with text
  • 1.11. Logarithmic and other nonlinear axes
  • 1.12. plt.plot() vs ax.plot()
  • 1.13. Assignment
• 2. Matplotlib Pandas
  • 2.1. Visualizing data
• 3. Matplotlib Charts
  • 3.1. Bars
  • 3.2. Histogram
  • 3.3. Scatter plot
  • 3.4. Stack plot
  • 3.5. Pie chart
  • 3.6. Nested Pie Chart
  • 3.7. 3D
  • 3.8. Assignments
• 4. Matplotlib Plot Lifecycle
  • 4.1. A note on the Object-Oriented API vs Pyplot
  • 4.2. Our data
  • 4.3. Getting started
  • 4.4. Controlling the style
  • 4.5. Customizing the plot
  • 4.6. Combining multiple visualizations
  • 4.7. Saving our plot
  • 4.8. Assignment
• 5. Matplotlib Examples
  • 5.1. Gallery
  • 5.2. Matplotlib and Jupyter
  • 5.3. Points
  • 5.4. Line Chart
  • 5.5. Multiple Charts
  • 5.6. Box Chart
  • 5.7. Bars
  • 5.8. Annotate
  • 5.9. Scales
  • 5.10. Pie Chart
  • 5.11. 3D
  • 5.12. Grid
  • 5.13. Legend using pre-defined labels
  • 5.14. Radar Chart
• 6. Plotly
  • 6.1. Installation
  • 6.2. Offline usage
  • 6.3. Jupyter Usage
  • 6.4. Plot Controls & IPython widgets
  • 6.5. Charts
  • 6.6. Time Series
  • 6.7. Two plots
  • 6.8. 3D Plotting
• 7. Bokeh
  • 7.1. Installation
  • 7.2. Download Sample Data
  • 7.3. Charts
• 8. Seaborn
• 9. Generowanie grafów
  • 9.1. PyDotPlus
  • 9.2. Graphviz
• 10. Projektowanie GUI
  • 10.1. Graphical User Interfaces with Tkinter
  • 10.2. Biblioteka Tkinter

Machine Learning

Machine Learning

• 1. Wprowadzenie do statystyki
  • 1.1. Rozkłady
  • 1.2. Podstawowe pojęcia
• 2. Wprowadzenie do Machine Learning
  • 2.1. Czym jest uczenie maszynowe?
  • 2.2. Co trzeba wiedzieć przed rozpoczęciem pracy?
  • 2.3. Ważne pytania przed przystąpieniem do tworzenia algorytmu
  • 2.4. Czyszczenie Danych
  • 2.5. Praca z bibliotekami
  • 2.6. Kategorie algorytmów uczenia maszynowego
• 3. Słowniczek intuicyjny
• 4. Słownik Pojęć
• 5. Datasets
  • 5.1. Skąd wziąć dane testowe?
• 6. Machine Learning Algorithms
  • 6.1. Regression Algorithms
  • 6.2. Instance-based Algorithms
  • 6.3. Regularization Algorithms
  • 6.4. Decision Tree Algorithms
  • 6.5. Bayesian Algorithms
  • 6.6. Clustering Algorithms
  • 6.7. Assoication Rule Learning Algorithms
  • 6.8. Artificial Neural Network Algorithms
  • 6.9. Deep Learning Algorithms
  • 6.10. Dimensional Reduction Algorithms
  • 6.11. Ensemble Algorithms
  • 6.12. Other Algorithms
• 7. Features
  • 7.1. Czym są features?
  • 7.2. Przykład praktyczny
  • 7.3. What Makes a Good Feature?
  • 7.4. Assignments
• 8. Classifiers
  • 8.1. Co to jest Classifier?
  • 8.2. Schemat działania classifiera
• 9. scikit-learn
  • 9.1. Loading Sample Datasets
  • 9.2. Fit and Predict
  • 9.3. Classifier
  • 9.4. Feature Selection
  • 9.5. Evaluation
  • 9.6. Label Encoder
  • 9.7. Writing Own Classifier
  • 9.8. Zadania praktyczne
• 10. Model Quality
  • 10.1. Metody doboru modelu i poprawienia jakości
  • 10.2. Słownictwo
  • 10.3. Diagnostyka Bias vs. Wariancja
  • 10.4. Model Evaluation Procedure
  • 10.5. Regularyzacja
  • 10.6. Random Forrest
  • 10.7. Ensemble averaging
• 11. Decision Tree
  • 11.1. Visualizing a Decision Tree
  • 11.2. Zadania praktyczne
• 12. k Nearest Neighbors
  • 12.1. Jak działa algorytm “K najbliższych sąsiadów”
  • 12.2. Przykład praktyczny
  • 12.3. Określanie przynależności do zbioru
  • 12.4. Wyznaczanie odległości
  • 12.5. Zalety i wady
  • 12.6. Assignments
• 13. Bayes
  • 13.1. Co to jest Naiwny klasyfikator Bayesowski?
  • 13.2. Gaussian Naive Bayes
  • 13.3. Przykłady praktyczne
  • 13.4. Plusy i minusy Naiwnego Bayesa
  • 13.5. Aplikacje Naiwnego klasyfikatora Bayesa
  • 13.6. Przykłady praktyczne
  • 13.7. Zadanie kontrolne
• 14. Linear Regression
  • 14.1. Co to jest Linear Regression?
  • 14.2. Przed zastosowaniem
  • 14.3. Wyznaczanie równania prostej
  • 14.4. Funkcja przedziałami liniowa
  • 14.5. Przykłady praktyczne
  • 14.6. Assignments
• 15. Logistic Regression
  • 15.1. Co to jest Logistic Regression?
  • 15.2. Linear vs Logistics
  • 15.3. Podstawowe pojęcia
  • 15.4. Przykład zastosowania
  • 15.5. Assignments
• 16. Support Vector Machines
  • 16.1. TL;DR
  • 16.2. Charakterystyka algorytmu
  • 16.3. Opis algorytmu
  • 16.4. Support Vector Machines (Kernels)
  • 16.5. Przykłady praktyczne
  • 16.6. Assignments
  • 16.7. Lektura uzupełniająca
• 17. Clustering
  • 17.1. Przykłady zastosowania
  • 17.2. Algorytmy klastrowania
  • 17.3. Flat Clustering
  • 17.4. Hierarchical Clustering
  • 17.5. Porównanie algorytmów
  • 17.6. Przykład praktyczny
  • 17.7. Assignments
• 18. Principal Component Analysis (PCA)
  • 18.1. What is Principal Component Analysis?
  • 18.2. 2D example
  • 18.3. 3D example
  • 18.4. Przykłady praktyczne
  • 18.5. Assignments
• 19. Neural Network
  • 19.1. What Is a Neural Network?
  • 19.2. Słownictwo
  • 19.3. Przykład praktyczny
  • 19.4. Tools
  • 19.5. Działanie na sieciach neuronowych
  • 19.6. Przetwarzanie obrazów na przykładzie rozpoznawania odręcznie napisanych cyfr (MNIST)
  • 19.7. Przykłady praktyczne
  • 19.8. Assignments
• 20. Convolutional Neural Network
  • 20.1. Problemy z przetwarzaniem obrazów
  • 20.2. What is and Kernel Convolution?
  • 20.3. What is Convolutional Neural Network (CNN / ConvNet)
  • 20.4. Przydatne odnośniki
• 21. Przydatne odnośniki
  • 21.1. Neural Networks
  • 21.2. Understanding the Bias-Variance Tradeoff
  • 21.3. Bayes
  • 21.4. PyMC3
  • 21.5. Inne
• 22. Notes
  • 22.1. Program
  • 22.2. Program 2
  • 22.3. Notatki
  • 22.4. Data Science
  • 22.5. Jupyter
  • 22.6. Machine Learning
  • 22.7. Metody bez nadzoru

Django

Django

• 1. HTTP
  • 1.1. Narzędzia
  • 1.2. DNS
  • 1.3. HTTP Protocol
  • 1.4. HTTP Methods
  • 1.5. HTML + JS + CSS
• 2. Introduction to Django
  • 2.1. Co to jest Django?
  • 2.2. Dokumentacja
  • 2.3. Wersjonowanie
  • 2.4. setup.cfg
  • 2.5. IDE Support
• 3. Django Framework Architecture
  • 3.1. Framework Architecture
  • 3.2. Request-Response flow
• 4. Installation and Running
  • 4.1. Instalacja
  • 4.2. Starting new project
  • 4.3. IDE Run configuration
• 5. Settings
• 6. Apps
  • 6.1. Reusability
  • 6.2. Location
  • 6.3. Create
  • 6.4. Structure
  • 6.5. Configuration
• 7. Models
  • 7.1. Model Fields
  • 7.2. Model field arguments
  • 7.3. Abstract Models
  • 7.4. Architecture
  • 7.5. Single File vs. Models per file
  • 7.6. Reverse engineering database
  • 7.7. Database schema migration
  • 7.8. Example Model
  • 7.9. Assignments
• 8. URL Router
  • 8.1. Global URLs
  • 8.2. In app URLs
  • 8.3. urlpatterns
  • 8.4. path
  • 8.5. url
  • 8.6. include
  • 8.7. URLs reversing
  • 8.8. URLs in templates
• 9. ORM
  • 9.1. QuerySet
  • 9.2. Field lookups
  • 9.3. Filters can reference fields on the model
  • 9.4. Complex lookups with Q objects
  • 9.5. Comparing objects
  • 9.6. Q() expressions
  • 9.7. F() expressions
  • 9.8. Aggregations
• 10. Views
  • 10.1. Class Based Views
  • 10.2. Generic Views
  • 10.3. Responses
  • 10.4. Permissions in Views
• 1. Forms
  • 1.1. Forms
  • 1.2. Model Forms
  • 1.3. Widgets
• 11. REST
  • 11.1. RESTful Views
  • 11.2. python -m json.tool
  • 11.3. django-rest-framework
  • 11.4. django-rest-swagger
• 12. Staticfiles
  • 12.1. Settings
  • 12.2. Serving staticfiles
• 13. Templates
• 2. Templatetags
  • 2.1. Filters
  • 2.2. Simple Tags
  • 2.3. Assignment tags
  • 2.4. Block tags
• 14. Admin panel
  • 14.1. Customizong
  • 14.2. Permissions
  • 14.3. Model Admin
  • 14.4. Model Inlines
  • 14.5. Extending Admin
  • 14.6. ModelAdmin Example
  • 14.7. django-import-export
  • 14.8. Grapelli
• 15. Management Commands
  • 15.1. Built-in
  • 15.2. Writing own management commands
• 16. i18n and l10n
  • 16.1. Timezone
  • 16.2. i18n - internationalization
• 17. Database
  • 17.1. Database schema migration
  • 17.2. Management commands
  • 17.3. Database settings
  • 17.4. Fixtures
  • 17.5. Multiple DB and db routing
• 18. Cache
• 19. Signals
  • 19.1. Available signals
  • 19.2. Examples
• 3. Auth and Permissions
  • 3.1. Basic Auth
  • 3.2. Require Permissions
• 4. API CORS
• 20. Standalone scripts
• 21. Tests and quality
  • 21.1. Tests
  • 21.2. Test URLs
  • 21.3. SonarQube
  • 21.4. Debug Toolbar
• 5. Tests
• 22. CI/CD - Continuous Integration and Deployment
  • 22.1. Bitbucket Pipelines
  • 22.2. Travis
• 23. Deployment
  • 23.1. Deployment platforms
  • 23.2. Packaging
  • 23.3. Staticfils serving

Blogposts

Blogposts

• 1. Wprowadzenie do Machine Learning w Pythonie
  • 1.1. Czym jest uczenie maszynowe?
  • 1.2. Co trzeba wiedzieć przed rozpoczęciem pracy?
  • 1.3. Ważne pytania przed przystąpieniem do tworzenia algorytmu
  • 1.4. Czyszczenie Danych
  • 1.5. Praca z bibliotekami
  • 1.6. Kategorie algorytmów uczenia maszynowego

Workshop

Appendixes

Appendixes

• 1. History
• 2. BDFL - Guido van Rossum
• 3. Name
• 4. PSF - Python Software Foundation
• 5. Further reading
  • 5.1. Documentation
  • 5.2. Working with Excel
  • 5.3. IDE - Integrated Development Environment
  • 5.4. Others
  • 5.5. IT Fun
  • 5.6. Wyzwania i potyczki
• 6. Books
  • 6.1. Algorithms
  • 6.2. Databases
  • 6.3. Software Engineering Practises
  • 6.4. Design patterns
  • 6.5. Refactoring
  • 6.6. Python
• 7. Video
  • 7.1. Collections of videos
  • 7.2. Python
  • 7.3. Machine Learning and Data Science
  • 7.4. Filmy z ostatnich konferencji
• 8. Python 2 vs. 3
  • 8.1. six
  • 8.2. Lista kompatybilności Python 2 i Python 3
  • 8.3. Unicode i kodowanie znaków
  • 8.4. Biblioteki standardowe w 2 i 3
• 9. Python WAT?!
• 10. TODO
  • 10.1. Book TODO
  • 10.2. Python PEP
• 11. Copyright
  • 11.1. MIT License
• 1. Bibliography
• 12. Glossary