Introduction
Data Entry page (Manual Data File Upload Page) enables users to create a new instrument into Geosens project system by uploading INIT / REV / DATA files. After creating the instrument, the following original readings can be captured by Geosens for further graphing and reporting purposes.
How to access the page: Click on the top left corner to open the side bar, click on ‘Data Entry' to access the page.
Data Entry Page contains two key components:
Manual Data File Upload Section: To prepare, upload and create instrument files.
Data Acquisition Jobs: To monitor the processing and status of uploaded files.
1. Data Entry Page Section Overview
This section provides introductions of each function on the page.
1) Manual Data File Upload Section
This is the place where you specify the Instrument Type and Data Input Form, then select the files you want to upload. Key elements include:
Instrument Type: A dropdown listing supported instruments in this project (e.g., Baseline Optical Survey Target, Inclinometer, etc.).
Data Input Form: The specific form or template for parsing data (e.g., “New Survey Convergence Prism from PQWT”).
Data Input Form Template: After selecting the instrument type and data input form, there will be a template file located at the bottom of instrument type field (e.g., SURVEY_3D-CVO_1_INIT-NEW_TEMP), available to be downloaded, filled-in as formatted, and uploaded.
Data Files: A button or field to upload one or more files from your computer.
2) Data Acquisition Jobs Section
This lower section displays previously uploaded files, and it contains two tabs of 'Uploaded Files' and 'Jobs Status'.
For tab 'Uploaded Files':
It shows the file uploading history list.
Instrument Type: The selected instrument type to which the file was uploaded and under which the instrument was created.
Data Input: the selected data input type when uploaded the file.
File Name: The name of the uploaded file.
File Size: The size of the file (KB, MB).
Uploaded By: The email address of the person who uploaded the file.
Uploaded On: The timestamp of when the file was uploaded.
For tab 'Jobs Status':
It shows the processing status of the uploaded file (successful / unsuccessful; the number of rows been processed from the file; etc).
Job Type: Category or purpose of the job (e.g., EVAL is for initial INIT / REV data set up; DATA is for readings upload).
Job Name: Descriptive label (e.g., Survey DATA File Reader with Action Codes - take instrument readings from DATA files into system).
Data Input Form: Specifies the data input form/template used for parsing.
Started On: Date and time the system began processing the file.
Completed On: Date and time the job finished processing (blank if still in progress).
Status: Reflects the current state (e.g., Succeeded, Failed, In Progress).
Processed Row Count: Number of data rows successfully parsed from the file. Users can check if all the rows in the file been successfully processed into Geosens.
File URL: Link to the original uploaded file uploaded in the system.
Ignored Instruments: Count of any instrument references the system could not match or recognize.
Ignored Raw Data: The content of the raw data that has been ignored.
Message: System-generated notes, warnings, or errors for the job (useful for troubleshooting).
2. Steps to Upload Files and Create an Instrument
This section provides instructions on uploading files (INIT / REV / CALI / DATA) to create a new instrument and check the uploading and processing status.
1) Data Entry General Steps
Navigate to the Data Entry page via the side functional bar.
Locate the Instrument Type dropdown. Select the instrument type that matches the data you want to upload (e.g., Baseline Optical Survey Target, Convergence Prism, Magnetic Extensometer).
Click on one selection from the data input forms. It must be prepared in the sequence of INIT -> REV -> CALI (Optional) -> DATA.
Click on a data input form template, which will be shown at the bottom and ready for download. The template file contains sample data, which must be thoroughly reviewed and updated to match the project's specific requirements.
Fill in the specific data for the instrument according to the template format. Save the file to your local device, then click the Data Files button to upload it.
Repeat step 1-4 to complete the data upload process for each instrument type and each data input form. In most cases, the file upload process should follow this sequence:
INIT: Initial setup data, including Instrument names, Easting, Northing, etc. Upload compulsory.
REV – Property: General revision property information, including alarm limits. Upload compulsory.
CALI: Instrument Calibration data upload & set up. Upload compulsory for a new instrument that requires calibration set up.
DATA: Upload instrument recorded readings. Upload is compulsory if data is available.
Note: The standard sequency is INIT -> REV -> CALI (Optional) -> DATA. It means Revision Property (REV) cannot be created before Instrument INIT is done.
Note: Only certain instrument types, such as Inclinometers and Vibrating Wire instruments, require CALI data.
For detailed instructions on preparing INIT, REV - Property, REV – Param, REV – Carry Over, REV - Alarm, CALI, and DATA files for different instrument types, please refer to data file upload by different instrument types (to be developed).
3. Steps to View Uploaded Files and Processing Status
This section provides instructions on how to check the file upload and processing status.
1) Check File Uploading History
Click on the tab 'Uploaded Files' to view all the file uploading history.
You can use filter icon next to the column header to filter instrument type / data input form / file name for quick file locate.
Click on the file name link to check the file content that has been uploaded to the system.
2) Check File Processing Status
Click on tab 'Jobs Status' to view the data acquisition jobs
Use the filter next to the column header to quickly filter by job name / data input form / starts on to locate the file you want to check.
Check the status, processed row count, ignored instruments, ignored raw data to verify whether the file has been processed successfully or not.
NOTE: The meaning of different status:
Succeed - All the contents have been processed successfully into Geosens.
Warning - None or Partial rows been processed successfully. Please check the processed row count / Ignored instruments / ignored raw data and especially message to verify the problem.
3) Sorting / Filtering / Download / Refresh:
Sorting: Click column headers (e.g., File Name, Uploaded On) to sort.
Filtering: Use the filter icon next to the column header and type to apply filter and narrow down the results.
Download: Click on the File URL link to download the uploaded file.
Refresh: Click refresh to update the processing status.
Re submit: click to select an existing data acquisition job and click on Re Submit button to re-process the same file. This function can be used when, for example, REV data is missing, and DATA file has been uploaded already. After fixing REV data, you may click on Re-submit to redo the acquisition job for DATA, without manually uploading file again.
4. Best Practices
Use Consistent File Names: Include the date or site ID in filenames to keep them organized.
Check Instrument Type: Always confirm you’ve selected the correct type before uploading.
Validate File Format: Ensure your CSV or XLSX matches the required column headers or structure.
Track Versioning: If re-uploading data, differentiate files by version or date to avoid confusion.
Mind File Size: Large files may take longer to process. Consider splitting extremely large datasets if necessary.
Investigate Ignored Data: A high number of ignored rows or instruments indicates potential mismatches in file format or instrument IDs.
Leverage the Message Column: For any issues, check the Message for clues on what went wrong. Please seek advice from project administrator.
5. Troubleshooting
Upload Failure: Verify that the file format is supported and not corrupted or in use by another program.
Incorrect Instrument Type: If data doesn’t appear where expected, re-check the instrument type you selected.
Missing Data: If the system indicates successful upload but data isn’t visible, confirm the correct template was used and that the file structure is valid.
Permissions: If you can’t see certain files or can’t upload at all, you may need additional user roles or permissions.