← Back to Curriculum

File I/O and Working with Files

📚 Lesson 6 of 20 ⏱️ 40 min

File I/O and Working with Files

40 min

Python provides powerful and intuitive functions for file operations, making it easy to read from and write to files. The `open()` function is the primary tool for file operations, supporting various modes like read ('r'), write ('w'), append ('a'), and binary modes ('b'). Understanding these modes is crucial for proper file handling.

File handling in Python follows a simple pattern: open the file, perform operations, and close it. However, manually closing files can lead to resource leaks if exceptions occur. This is where the `with` statement becomes invaluable for automatic resource management.

The `with` statement (context manager) automatically handles file closing, even when exceptions are raised. This ensures proper resource management and prevents file handle leaks. It's considered the Pythonic way to work with files and is essential for production code.

Python supports both text and binary file modes. Text mode handles encoding/decoding automatically (default UTF-8), while binary mode works with raw bytes. Understanding when to use each mode is crucial for handling different file types like images, videos, or encoded text files.

File reading methods include `read()` (entire file), `readline()` (single line), and `readlines()` (all lines as list). For large files, iterating over the file object directly is memory-efficient as it reads line by line without loading everything into memory.

Writing to files can be done with `write()` for strings or `writelines()` for lists of strings. Remember that `write()` doesn't automatically add newlines, so you must include `\n` when needed. The `pathlib` module provides a modern, object-oriented approach to file paths.

Key Concepts

  • The open() function is used to open files with different modes (r, w, a, b).
  • The with statement ensures files are properly closed automatically.
  • Text mode handles encoding, binary mode works with raw bytes.
  • Different read methods serve different purposes (read, readline, readlines).
  • File paths can be absolute or relative to the current working directory.

Learning Objectives

Master

  • Opening and closing files using the with statement
  • Reading files using different methods (read, readline, readlines)
  • Writing data to files in text and binary modes
  • Handling file paths and working with directories using pathlib

Develop

  • Resource management thinking and best practices
  • Understanding file encoding and binary data handling
  • Error handling for file operations and edge cases

Tips

  • Always use the with statement for file operations to ensure proper cleanup.
  • Use pathlib.Path for modern, cross-platform file path handling.
  • For large files, iterate over the file object instead of reading everything at once.
  • Be explicit about file encoding when opening text files (encoding='utf-8').

Common Pitfalls

  • Forgetting to close files when not using the with statement, causing resource leaks.
  • Opening files in write mode ('w') which overwrites existing content without warning.
  • Not handling FileNotFoundError when reading files that might not exist.
  • Mixing text and binary modes incorrectly, causing encoding errors.

Summary

  • The with statement is the recommended way to handle files in Python.
  • Different file modes serve different purposes (read, write, append, binary).
  • Python automatically handles encoding in text mode (default UTF-8).
  • Proper file handling prevents resource leaks and ensures data integrity.

Exercise

Write a Python script to write 'Hello, World!' to a file named 'test.txt'.

with open("test.txt", "w") as f:\n  f.write("Hello, World!")\n\n# To verify, you can read it back\nwith open("test.txt", "r") as f:\n  print(f.read())

Exercise Tips

  • Try using pathlib.Path for more modern file handling: Path('test.txt').write_text('Hello, World!').
  • Add error handling with try-except for FileNotFoundError and PermissionError.
  • Experiment with append mode ('a') to add content without overwriting existing files.
  • Use encoding parameter explicitly: open('file.txt', 'r', encoding='utf-8') for clarity.

Code Editor

Output