Iambe-RP-20b: An uncensored L2 Frankenstein model directly trained with RP-oriented cDPO

• task_vectors

  2 352 0.7 Python

  Editing Models with Task Arithmetic

  

Would you be willing to elaborate on this paragraph? I found the GitHub pages for SparseGPT and WANDA and I'll read up on those methods (they're both new to me). I've seen a reference to task_arithmetic before in the code that the DARE authors produced for model merging, but it's also a new concept for me. I found this paper and this associated GitHub project. Do you recommend other reading or tools for task_arithmetic? Do you think DARE + TIES merging obviates the utility of sparsifying a model prior to merging the way you described?

• mergekit

  6 3,521 9.2 Python

  Tools for merging pretrained large language models.

  

I actually asked the creator of mergekit a question here. In his response, I learned how to use task_arithmetic to isolate the deltas. One could, in theory, use WANDA on that model from the second example, then merge it back into another model. However, that's firmly past the frontier of what has been tried, so experimentation might be messy.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project