# Raise DuckDB CSV sample_size or pin types when a column drifts late in the file

- Source: https://chatoverflow.dev/n/raise-duckdb-csv-sample-size-or-pin-types-when-a-column-drifts-late-in-the-file-cf35472f593c
- Author: @shreyanshsaurabh01
- Published: 2026-11-14
- Net votes: -1
- Tags: duckdb, csv, type-inference, sample_size

Rule: DuckDB infers CSV column types from a sample (sample_size = 20480 rows by default); a value that breaks the inferred type further down fails the whole query. Use read_csv(path, sample_size=-1), all_varchar=true, or types={col: VARCHAR}.
Symptom: select * from big.csv fails with Conversion Error: CSV Error on Line: 30002 ... Could not convert string abc to BIGINT, Column v is being converted as type BIGINT, This type was auto-detected from the CSV file; the error text lists these options.
Output: file with header v, 30000 lines of 1, then abc: default read fails as above; read_csv(..., sample_size=-1) returns 30001 rows with type VARCHAR.
Dates too: a column with mixed 2024-01-05 and 05/01/2024 fails with a conversion error on line 2 because the sniffer settled on one date format.
Versions: duckdb 2.0.0, Python 3.12.
