Survey CSV & Excel Cleaner (PENZD)
Consolidate up to 100 independent survey data files (CSV, TXT, Excel). Re-map coordinates dynamically to correct orientations, perform bulk elevation Shifts, standardize description codes, and check point locations on an interactive 2D coordinate canvas.
Drag & Drop Survey Files
Support up to 100 coordinates files simultaneously. Accepts .csv, .txt, .dat, and Excel .xlsx spreadsheets.
Engineering Notice & Review Requirement:
Calculation generated by InfraDigital CAD based on the selected methodology and entered parameters. Project-specific engineering review and verification are required before final design, submission or construction use.
Survey CSV Cleaner (PENZD) Documentation
Technical specifications, mathematical formulas, and civil guidelines
1. Functional Purpose & Methodology
Topographic field data collected via Total Stations, GNSS RTK rovers, and drone photogrammetry frequently contain formatting defects: duplicate point numbers, text characters in numerical coordinate fields, inverted Northing/Easting columns, and out-of-range elevation spikes. The Survey CSV Cleaner automates the detection and resolution of these anomalies, transforming messy raw survey data into clean, standardized PENZD (Point, Easting, Northing, Elevation, Description) format.
Importing unvalidated coordinate files directly into Autodesk Civil 3D or Bentley OpenRoads can corrupt digital terrain models (TIN surfaces), causing inverted contour triangles and incorrect earthwork volume calculations. This tool parses, filters, and standardizes survey files completely client-side.
2. Practical Step-by-Step Instructions
- Upload Raw Survey File: Drag and drop your raw CSV, TXT, or DAT coordinate listing into the file upload box.
- Auto-Detect or Map Columns: The system automatically detects delimiters (comma, space, tab, semicolon) and maps columns to Point ID, Easting, Northing, Elevation, and Feature Code.
- Configure Filtering Rules: Set minimum and maximum elevation thresholds (e.g., 1,500m to 2,800m), toggle duplicate point number deduplication, and enable description uppercase normalization.
- Review Outlier Diagnostics: Inspect flagged anomalies in the interactive data table, showing rows with invalid coordinates, negative elevations, or missing descriptions.
- Export PENZD File: Download the sanitized, comma-delimited PENZD file ready for immediate surface building in Civil 3D.
3. Mathematical Formulations & Statistical Filtering
Outlier detection applies spatial distance deviation and Z-score statistical screening across survey point clusters:
- Spatial Coordinate Distance Deviation (d_i):d_i = √[ (E_i - E_mean)² + (N_i - N_mean)² ]Where E_i, N_i are individual point coordinates, and E_mean, N_mean are the centroid coordinates of the surveyed corridor segment.
- Elevation Z-Score Outlier Identification:Z_score = |Z_i - μ_Z| / σ_ZWhere Z_i = point elevation, μ_Z = mean elevation, and σ_Z = standard deviation of elevations. Points with Z_score > 3.5 are flagged as vertical anomalies.
- Coordinate Inversion Detection: Compares Easting (6 digits, e.g., 400,000m to 600,000m in UTM Zone 37N) vs. Northing (7 digits, e.g., 900,000m to 1,200,000m) to prevent swapped coordinate axes.
4. Standard Survey Feature Codes (PENZD Standard)
Standard description coding ensures automatic breakline generation and figure prefix mapping in CAD:
| Feature Code | Description | Civil 3D Surface Role |
|---|---|---|
| CL / CLR | Centerline of Existing Road | Standard Breakline |
| EP / EPR / EPL | Edge of Pavement (Right / Left) | Standard Breakline |
| SH / SHR / SHL | Shoulder Hinge Point | Standard Breakline |
| TOE / TOP | Toe of Slope / Top of Cut | Daylight Breakline |
| CULV / INVERT | Culvert Inlet / Outlet Invert | Drainage Non-Surface Point |
| BM / TBM | Benchmark / Control Point | Geodetic Control Point |
5. Output Interpretation & Surface Quality Control
Before creating a TIN surface from cleaned data:
- Duplicate Point Resolution: Check the deduplication summary to ensure control points (BMs) were not accidentally overwritten by detail shots.
- Zero Elevation Points: Verify that no points with Z = 0.000m exist, as these pull the triangulation down to sea level, creating severe cone-shaped sinkholes.
- Breakline Crossing Check: Ensure surveyed stringlines do not cross each other before importing them into surface definitions.
6. Related Technical Guides & Workflow Integration
For best practices on survey point formatting and breakline management in Civil 3D, read our guides on Standardization of Highway Survey Points and Survey Breaklines in Civil 3D.