Plugin concept GatherAssist - Gather multiple items with one command

[ZaneMcFate]

Alpha 0.3.5 posted; two known bugs:
- gear set update triggering oddly and saving incomplete gear set records
- Unknown items are never gathered

Assuming no major bugs are found, there are still a few features to add, then the item survey, and we'll be in beta.

 

[ZaneMcFate]

Alpha 0.3.6 posted:
- No bug fixes
- added HQ flag for gathering only High Quality items
- added AutoSkip logic for testing and possibly production: skips over items which are taking too long to complete
- added shard-based spell selection logic (uses shard-doubling spells where appropriate)

 

[Yasuko]

Zane, I had an idea.. instead of harvesting via name, what if you selected the slot number instead? .. I'm not sure if that still works for Unknowns but worth a try. Then just add a column to your list for slot number and reference it via the name column?

Edit: also I'm thinking of going ahead and scraping items from xivdb and putting them into an sqlite db, would that be of interest to you for this project?

 

[ZaneMcFate]

Zane, I had an idea.. instead of harvesting via name, what if you selected the slot number instead? .. I'm not sure if that still works for Unknowns but worth a try. Then just add a column to your list for slot number and reference it via the name column?

Yes, that does work, and that's how I'm going to have to get around it. Unfortunately, that sort of information is not readily available on a database anywhere, so I'll need to survey it myself.

also I'm thinking of going ahead and scraping items from xivdb and putting them into an sqlite db, would that be of interest to you for this project?

That would be immensely helpful, not only for this items issue, but for things like crafting materials, required skill levels, etc.; to be able to pull those from a database when populating what will ultimately be massive data tables, will save a lot of time and avoid a lot of manual error.

 

[Yasuko]

I've used html agility pack to scrape voip call data from our call center website at work, but the div containers are named properly for it lol.. xivdb doesnt have a great naming convention that i've seen.. but I figured it would be worth a try tonight while I'm bored at work lol.. I'll see what I can do, and get back to you at some point tomorrow.

 

[Dgame]

Am I doing something wrong? I see you have update 3.6 but in plugins it still shows me with Ver. 3.4.

 

[ZaneMcFate]

Alpha 0.3.7 posted:
- Added level-based gathering spell logic
- Fixed that nasty gear set switching bug
- Added the ability to define slot numbers in item records so that Unknown items can still be gathered

And with that, NO BUGS! ...until more are found, but I'm optimistic! Time to begin surveying items to populate the engine, and once I have a couple regions, I will push this to Beta.

 

[ZaneMcFate]

Am I doing something wrong? I see you have update 3.6 but in plugins it still shows me with Ver. 3.4.

Must be; throw the GatherAssist.cs into a text editor and search for "Version"; it should say 0.3.7 in the latest release... or are you using SVN? It's possible I messed something up on that feed, I'll check that too.

Update: I confirmed the SVN download accesses the master branch.

 

[Dgame]

I re-downloaded it and now I have the correct version. The odd thing is, is that it's still in its own "Plugins" folder. I also don't get the green little check mark on the folder to show it's working with SVN.

 

[Dgame]

I just pulled GatherAssist out of the plugin folder, but still doesn't show the green check mark. I have other SVN's working, so I'm not sure what I'm doing wrong

 

[ZaneMcFate]

I wish I could see what it's doing; the SVN link posted on this thread points directly to the plugin itself, so GA SVN Folder => RebornBuddy\Plugins\GatherAssist

 

[Yasuko]

I noticed you mentioned that there wasn't really a DB source that had items per slot, per location. I went riding around La Noscea tonight using the below code, and gathered these location/slots/itemsid/items.. I'll update this post with each area once i get them done. The Code I used, if anyone else is curious about mapping out some places is:

  Log("ZoneID: {0} \nLocation: {1} \nNode: {2}",WorldManager.ZoneId,Core.Me.Location,Core.Me.CurrentTarget);
  foreach (GatheringItem item in ff14bot.Managers.GatheringWindow.GatheringWindowItems)
      {
          Log("Slot {0} ItemID: {1} Name: {2}",item.SlotIndex,item.ItemId, item.ItemData.EnglishName);
      }
    foreach (var teleID in WorldManager.AetheryteIdsForZone(WorldManager.ZoneId))
       {
           Log("\nAetheryteId: {0}",teleID.Item1);
         }

I just used the closest AetheryteID to the location the nodes were at. Also, on some of these I replaced the Location to a more central location evenly between the cluster of nodes.. I did this on my second account since my primary account was busy, and unfortunately botany on second account is only in the 20s.. i'll get botany locations once my primary account is finished.

La Noscea (Mining):

Spoiler

//Middle La Noscea
ZoneID: 134
Location: <-309.0062, 28.51375, -559.4216>
Node: Lv20 Rocky Outcrop 0x127FE100
Slot 0 ItemID: 5599 Name: Grade 1 Carbonized Matter
Slot 4 ItemID: 2 Name: Fire Shard
AetheryteId: 52 //Summerford Farms

//Western La Noscea
ZoneID: 138
Location: <748.418, 36.01468, 423.9249>
Node: Lv50 Rocky Outcrop 0x127FCE40
Slot 0 ItemID: 5601 Name: Grade 3 Carbonized Matter
Slot 4 ItemID: 3 Name: Ice Shard
Slot 5 ItemID: 9 Name: Ice Crystal
AetheryteId: 13 //Swiftperch

//Western La Noscea
ZoneID: 138
Location: <502.6386, 15.75926, 328.2848>
Node: Lv30 Rocky Outcrop 0x127FCE40
Slot 0 ItemID: 5600 Name: Grade 2 Carbonized Matter
Slot 4 ItemID: 3 Name: Ice Shard
Slot 5 ItemID: 9 Name: Ice Crystal
Slot 6 ItemID: 5817 Name: Grey Pigment
AetheryteId: 13 //Swiftperch

//Western La Noscea
ZoneID: 138
Location: <237.0026, -16.68559, 142.4525>
Node: Rocky Outcrop 0x127FE100
Slot 2 ItemID: 5229 Name: Mudstone
Slot 3 ItemID: 5230 Name: Limestone
Slot 4 ItemID: 3 Name: Ice Shard
AetheryteId: 14 //Aleport

//Western La Noscea
ZoneID: 138
Location: <370.0098, 7.185477, 67.89938>
Node: Mineral Deposit 0x127FFD20
Slot 0 ItemID: 5465 Name: Sunrise Tellin
Slot 4 ItemID: 3 Name: Ice Shard
Slot 7 ItemID: 5129 Name: Raw Danburite
AetheryteId: 14 //Aleport

//Upper La Noscea
ZoneID: 139
Location: <-440.7054, -13.14199, 202.5384>
Node: Lv30 Rocky Outcrop 0x127FDB60
Slot 2 ItemID: 5231 Name: Siltstone
Slot 4 ItemID: 5 Name: Earth Shard
Slot 7 ItemID: 5527 Name: Brimstone
AetheryteId: 15 //Camp Bronze Lake (Ferry Access)

//Upper La Noscea
ZoneID: 139
Location: <-429.155, -1.672677, 97.65765>
Node: Lv25 Rocky Outcrop 0x12800680
Slot 3 ItemID: 5152 Name: Fire Rock
Slot 4 ItemID: 5 Name: Earth Shard
Slot 5 ItemID: 5157 Name: Water Rock
Slot 6 ItemID: 5156 Name: Lightning Rock
AetheryteId: 15 //Camp Bronze Lake (Ferry Access)

//Upper La Noscea
ZoneID: 139
Location: <433.6515, -3.4, 187.4071>
Node: Lv45 Mineral Deposit 0x127FD980
Slot 4 ItemID: 5 Name: Earth Shard
Slot 5 ItemID: 5115 Name: Electrum Ore
Slot 6 ItemID: 5145 Name: Raw Turquoise
AetheryteId: 15 //Camp Bronze Lake

//Eastern La Noscea
ZoneID: 137
Location: <387.2703, 29.83504, 306.9749>
Node: Lv35 Mineral Deposit 0x12800680
Slot 4 ItemID: 7 Name: Water Shard
Slot 5 ItemID: 5134 Name: Raw Garnet
Slot 6 ItemID: 5139 Name: Raw Aquamarine
Slot 7 ItemID: 5135 Name: Raw Goshenite
AetheryteId: 11 //Costa Del Sol

//Lower La Noscea
ZoneID: 135
Location: <250.8062, 74.58591, -307.4127>
Node: Lv30 Rocky Outcrop 0x127FD7A0
Slot 0 ItemID: 5600 Name: Grade 2 Carbonized Matter
Slot 4 ItemID: 5 Name: Earth Shard
Slot 5 ItemID: 5816 Name: Yellow Pigment
Slot 6 ItemID: 5818 Name: Brown Pigment
AetheryteId: 10 //The Moraby Drydocks

//Lower La Noscea
ZoneID: 135
Location: <10.649, 36.157, 658.28> //radius is bigger than normal, might need two hotspots?
Node: Rocky Outcrop 0x127FD5C0
Slot 0 ItemID: 5601 Name: Grade 3 Carbonized Matter
Slot 4 ItemID: 5 Name: Earth Shard
AetheryteId: 10 //The Moraby Drydocks

 

[ZaneMcFate]

Awesome, this will be quite useful! I just completed surveying AetheryteIDs 2 through 10, and I realize I need to upgrade the engine to handle multiple item sources and choose Aetherytes that the user already has available, so I will push that through and start testing yours and mine tomorrow if I can manage it. Excellent stuff!

 

[Yasuko]

Well things like shards and crystals are the same level no matter which node you are at.. I would just set their max mining/botany level to whichever it is when you are cycling through the gear sets.. if they are 50, wouldnt really matter which lvl node they went to for shards.. but if they are below 50, send them to the lowest node available that has that shard to prevent aggro and what not.

 

[ZaneMcFate]

Update: The profile validation has revealed several minor issues that I have been fixing as I go; in the end, it looks what I've wound up building is a mass profile validator I'm letting it run through piles of auto-generated items, and I'll update the plugin when I've given the green flag to most of them and flagged the ones that need fixing. It looks like the QA portion of this project will be more complex than I thought.

 

[ZaneMcFate]

Posted Alpha 0.3.9; a few minor changes, and most of the first survey is validated. Still need to add Yasuko's profiles and continue the survey, but this will likely be it for the holiday.

 

[Sodimm]

This is working great, I've just completed a request for 10 HQ of all the raw gemstone. No trouble. Although it doesn't seem to move on until it's @ +1 or 2 above intended target. Otherwise, perfect. The only adjustment i'd ask for is simply quality of life, Raw Peridot, and Raw Amethyst are from the same node, yet the profile does amethyst, then goes off to do another item, then returns for peridot. Making an un-needed teleport. Again, it's not neccesary, but in the aim of perfection. You're on your way. Thanks.

On a note of website data in regards to crafting, ffxiv.com own backend has all the required info that Libra Eorzea uses. Also consider Crafting as a Service | Final Fantasy XIV ARR Crafting Information which is what i generally use to generate crafting raw ingredient lists. I'd try and scrape them myself, but I've no idea how. Thanks for a promising plugin that i'll keep testing.

 

[ZaneMcFate]

Yes, that's an important piece, to do nearby items together, or at the very least, do the same map together. I'll look into this; thanks for the feedback!

 

[Dgame]

Not sure if it was intentional but some items have been removed. Like Button Mushrooms and Ruby Tomato.

 

[ZaneMcFate]

I did remove some of the original items temporarily, as I brought in about 100 in a new style with additional fields. I need to add a few new fields to those entries and turn them back on.