Our great sponsors
-
cog_stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
In general, for lora training I go with the alpca format described here. It was the first real training done on llama and the format's pretty widely supported as a result. There's a good chance anything that can train on data will support that format with little to no extra formatting needed.
You can save that overall set into a json file and load it up as training data in whatever you're using. I'm using axolotl for it at the moment. Though a GUI based option is probably best for the first couple of tries until you get a feel for the options.