fix: ETL vehicle db import fixes

This commit is contained in:
Eric Gullickson
2025-12-26 14:54:51 -06:00
parent fb52ce398b
commit 09410c3c3f
10 changed files with 67243 additions and 61980 deletions

View File

@@ -22,16 +22,14 @@ You are a senior software engineer specializsing in NodeJS, Typescript, front en
- Make no assumptions.
- Ask clarifying questions.
- Ultrathink
- You will be implementing a user security improvement.
- You will be fixing a bug with the vehicle catalog import.
*** CONTEXT ***
- This is a modern web app for managing a vehicle fleet. It has both a desktop and mobile versions of the site that both need to maintain feature parity. It's currently deployed via docker compose but in the future will be deployed via k8s.
- Read README.md CLAUDE.md and AI-INDEX.md and follow relevant instructions to understand this code repository in the context of this change.
- There is a "Manage" button in the settings screen under "Security & Privacy" that is not implemented.
- Right now authentication is done via Auth0 with a robust onboarding workflow.
- When implementing the ability to manage your password in the app, we also need to add the ability for passkey authentication with Auth0
- We cannot break the onboarding workflow where users are not allowed to login until they are confirmed
- Auth0 passkey documentation is located here https://auth0.com/docs/native-passkeys-api.md
- There is an error when you try and upload a CSV file that is 15.1MB.
- The error says the file is too large
- We need to increase the max size to 25MB
*** CHANGES TO IMPLEMENT ***
- Research this code base and ask iterative questions to compile a complete plan.
@@ -47,17 +45,16 @@ You are a senior software engineer specializsing in NodeJS, Typescript, front en
- Make no assumptions.
- Ask clarifying questions.
- Ultrathink
- After updating the @sctips/inject-secrets.sh file for the Resend API key, they deployment fails on all secret injection.
- The initial data load for this applicaiton during the CI/CD process in gitlab needs to be updated
*** CONTEXT ***
- The secrets architecture is based of a future state of being deployed into k8s. Right now it's in docker compose with files that are copied in via the pipeline.
- Read README.md CLAUDE.md and AI-INDEX.md and follow relevant instructions to understand this code repository in the context of this change.
- The current deployment database load needs to be thoroughly critiqued and scrutenized.
*** ACTION - CHANGES TO IMPLEMENT ***
- Debug what could be causing this issue. No changes were made to the Gitlab server besides adding the RESEND variable so there shouldn't be anything on the server causing this issue.
$ chmod +x scripts/inject-secrets.sh
$ ./scripts/inject-secrets.sh
Running after script...
- The vehicle catalog currently loaded into the local mvp-postres container needs to be exported into a SQL file and saved as a source of truth
- Whatever process is running today only goes up to model year 2022.
- All the existing SQL files setup for import can be replaced with new ones created from the running mvp-postres data.