Changes

2010-01-03

More updates, here and there.

OK, so I've added a couple features, and brought a few others back from the grave. Sorry that this took as long as it did, there was a war and all, plus I had a problem with one of the Django schema evolution libs that the developers never were able to fix, so I had to dump it.

Major changes!

Skill queue support! (This also fixes display bugs where really long skill names would hide the completion time.)

Characters will start loading the queue with their next normal refresh. So it may be up to a hour from now before all your characters show their queue.
New EVE Central loader!

The EVE Central APIs have been very unhappy of late. I got a lot of fatal errors and permission denied trying to call them. So instead of the fancy XML API, I now load the nightly CSV dump file that they kindly provide. It actually loads a LOT faster as I can bulk process and filter it.
Manufacturing prices are back.

The missing data on what it would cost to make things is back now. You'll also see each line item's price now as quantity X unit_price, not just unit_price. (So it'll show that a module needs 500K ISK of Tritanium, not that Tritanium is trading around 2.34 ISK.)

Minor changes.

Item uses moved to their own page to not spam the item's page. (T2 materials have 100+ uses.)
Missing icons no longer display as broken. (CCP doesn't publish icons for everything.)
Large prices for items abbreviated and made smaller to not overlap the buy/sell price on mobile browsers.
Fixes for map loader. (Dominion removed many sov fields.)
NPC view link removed until I can extract the NPC stats from an older DB dump. (CCP removed them from the dump in Apoc.)

2009-09-22

We are back.

The EVE API is back up after the Alliance Tournament, and I've re-loaded all of the missing data. This fixes the broken POS and user views. Thanks for bearing with me.
The site seems pretty stable, and definitely faster than it was before.
Some things still to do include repopulating th NPC attributes from an older CCP export and watching my mail for any errors. (I've drastically increased the number of places where the app detects it's own errors and throws me an error on them. So bugs are getting squashed within minutes of them hitting my mailbox.)

Enjoy, and fly safe.

2009-09-19

The good, the bad, and the ugly.

I promised you updates, and now you've got them.

The Bad.

Let's start with the bad news, to get it out of the way.

CCP decided to remove all attributes for NPCs from the latest database dump.

Like it, or hate it, there will be no info on sleepers in the dump, but worse, they removed all the old NPC data as well. So my lovely old NPC views are just sitting there, devoid of stats.

I have saved the old database and will be trying to extrace at least the pre-Apocrypha data, to restore those views soon.

The site was down for like 5 hours!

Yeah, it took a long time to get all the changes in place. A lot of things changed besides the obvious (for example, the Widget is now in Mercurial, not Subversion).

The Ugly!

OK, now for the real problem. The API is offline and will be for the next two days on account of the Alliance Tournament.

With the updates, I have to wipe a lot of the data and reload from the API servers. Items like the alliance list, the corporations, etc. Without this, none of the personal data can load. I can't show your any characters or POSes, because there's no corporation or alliance record to link them to. So about half the Widget is DOA until CCP brings the API servers back online.

Yes, this means you'll get a lot of the cute 'Developer Error' pages, and I'll get a lot of automatic emails until this. I'm sorry, but there's nothing I can do to fix it faster.

Additionally, the API started acting very weird in the last hours, and even the EVE forums were giving 500 errors, so something is very broken in CCP's web farm.

The Good!

OK, could you use some good news now?

Apocrypha 1.5 data dump from CCP is loaded!

So you'll now see all the items that have been missing.

New rig calculator!

If you haven't checked out the rig calculator before, you owe it to yourself to do so now. It's over here. Not only does it now show Small/Medium/Large rigs, and in a new sexy table format, it's also a lot faster than it was before.

Improved memory footprint

The backend jobs that load your character data while you're not looking were choking the server, causing it to go down from time to time. This is now resolved, and we're running at less than 50% memory utilization now. So the crashes might be gone at last. (Too soon to know for certain, but I'm hopeful.)

Materials removed from items.

I took the material details for manufacture and invention off the items, and put them onto the blueprints. So if you want to know what it takes to build something, click on the blueprint for it, and you'll find everything you used to see. This change sped up the item views a fair bit for everyone.

Faster paint job.

I finally dug around Django's internals enough to get the caching to work reliably, I hope... We'll know in a bit. But for now, everything is a lot faster. I also did some SQL analysis on the more intensive pages and trimmed some of them down by nearly 80%.

Fixed character import

The embarrassing bug that would give an error when you first loaded your character is gone. Now you end up instead at the API log page, with a convenient link back to the character page.

Little display fixes

A lot of little bits fixed: icons for attributes, level for required skills, portion size, volume, capacity added to items, etc.

Fixes to alliance creation/deletion

Many of the loader problems seem to be related to problems that occurred when an alliance was disbanded. (It was deleting the solar systems, on account of how Django cascades deletes.) This is now fixed to (hopefully) break all links before the delete. Additionally, all CCP static data now should be undeleteable as well. (Two safety checks is better than one.)

Icons updated to Apocrypha 1.1

The graphics are now from the Apocrypha 1.1 release. (There is no 1.5 dump.) This adds a lot of alliance icons, as well as most of the new items. Only thing I've noticed missing is the medium and small rig blueprint icons.

2009-09-09

Hello again.

OK, it's been about six months since I really did much with the widget (except check my own skills), and if you've been following the EVE Alliance news, you probably know what I've been up to. (Hint: We lost.)

What now?

A lot has happened since the last time I worked on my Widget and it's high time I spent some more time of this site. So, here's what I'm working on currently:

Apocrypha 1.5 came out with it's new rigs for cruisers and frigs. Also a LOT of small DB changes. So time to update to the latest dump.
The rig calculator should show small/medium/large as a single line item I think, not separate entries, so that'll need adjusting to understand 'size'.
Django 1.1 was released: Updating to that will take a bit, but it's got a lot of fixes.
Various bugs have been captured in my inbox that need addressing. (Such as the embarrassing DeveloperError page when you first add your API key.)
Several of the loaders, such as some account's transactions, have stopped working. Need to get them going again, and make them report to me when they fail so I know next time.

A rich idea?

I've been thinking of a loot calculator for mission runners. Where you would tell the Widget to load all your assets, and then (in a couple mins when it's done loading them) you pick a station/hangar/whatever and tell it to advise you what to do with the loot there. What's worth selling in Jita? What's worth melting down?

Anything else?

But is there anything else that needs done?

Any major features you would like added?

Contact me: ash@dragonpaw.org.

2009-02-26

Changes:

Migrated all templates to Jinja2, allowing for easier and more flexible templates. While this isn't directly a user-visible change, it will allow me to add more features as time goes on. But it might also have broken some things. I tried to test everything I could, but I'll be watching closely my email for any of the 'Developer Error' messages that entertain you folks.
Improved (hopefully) layout for the NPC data. If you haven't looked at the NPC's recently, you owe it to yourself to do so. Click here to see.
Found some old NPC icons. CCP's latest graphic sets available don't include NPC icons, but some of the older ones did. I had to web scrape them, but I think I now have icons for all NPCs.
Password recovery now asks for email instead of username. People were forgetting the usernames they'd registered with.
One new feature that I would like feedback on: All members of an alliance, who are logged into their account, will now see what moons have POS on them and what corporation within the alliance has that POS when viewing the page for a solar system. If a user isn't logged in, or isn't part of the alliance, they will not see the POS. And no private data for the POS is available this way. Only the name of the corporation. So you can't see online status, fuel, or anything else this way. Within my alliance, it makes it easy to know what moons are free and plan your moon mining, but I hope other alliances will find it helpful as well.
Journal entries now have nice little icons on them. I tried to pick appropriate ones for the more common entries.
Market indexes for EVE Central no longer clickable. They are just too long and pointless to view.
Sov changes to 'none' now show old alliance icons.

Bug fixes:

Fixed a bug that was allowing an EVE API error to crash the POS loader. (This resulted in about a day and a half of not updating POS data for some corporations.)

2009-02-18

New:

Support for POS alchemy. (Rather than show the reactions as making 'Unrefined xxxx', I altered the data to show the refined outputs, for better cost/profit data.)

Bug fixes:

Cached run_until times on POSes were being cached far too long, so the fuel list page was showing old data.

2009-02-12

Whoops!

I'm very sorry for the 5 hour outage. A code push happened sooner than I realized, and the data wasn't updated with it. It is fixed now, and hopefully will not re-occur.

Big changes:

Massive amount of new caching code everywhere! Lots and lots of pages load a lot faster now.
POS view refactoring: There are now only 2 lists for POS (fuel and profit/cost) and 1 detail (profit/cost/fuel). Maybe this will encourage more people to setup owners and reactions.

Bug fixes:

Blueprints with a negative ME (Invention) now correctly calculate waste.
POS fuel calculations got some more love for power/cpu and should now be much closer. (Or slight over, based on EVE always rounding up consumption.)
Fixed: Players that had no transactions recorded were unable to set a custom price for something.
Various minor CSS and formatting glitches resolved.
Fixed: Non-alliance POS is low-sec were showing constellation-level discounts to fuel.

2009-01-29

Big changes

NPC data views added to the main menu. It's very sexy. Check it out. Seriously. Go look...

Small changes

Bug with the Derived index getting duplicated is now fixed.
Stations will now show the type. (Useful in 0.0 to know where the nearest refinery outpost is.)

2009-01-16

Big changes

Moved to entirely new hosting. Again. Sheesh. MediaTemple (old) raised the bill on me after only 2 days of hosting the Widget. So now it's running on a dedicated slice at SliceHost.
Refresh improvements: A lot of different little situations were making the refresh of data from EVE a little intermittent. (One of my characters showed a skill from a week ago still.) Clearing out the memcache instance erased a lot of data that for some reason had been cached far too long. (Not sure yet what happened, but I suspect that the API header from CCP gave incorrect cache expiration times for some data at one point.)
POS refresh no longer part of director refresh. Before, POSes updated when the director was reloaded. But if the director hadn't logged in for a week, or if the director had a failure on refresh, the POSes never got updated. Now an inactive director account only shuts down reload for the character data. POS data will always be updated. (Eventually I'll start actively purging old accounts with emailed warnings first.)

Small changes

POS ownership can now been seen/set by POS Caretakers.
POS reactions can now been seen/set by POS Caretakers.
Bug with multiple EVE Central indexes appearing fixed. There is now only one Jita, not 12. :)

2008-12-21

Known issues

Corporations with a lot of POSes will get 502 errors on looking at the consumption or profits page. The process is hitting max memory. I will need to optimize that chunk of code a lot to get the runtime and memory consumption down. A lot of the values will probably need to be pre-computed.

Big changes

Moved to entirely new hosting. The previous system was running out of memory and CPU, as it is hosting many other sites. So now the Widget has its very own hosting.
Database updated to Quantum Rise.
Framework updated to Django 1.1 pre-release. (Yes, the Widget runs in Django.)
Entirely new icon sets for QR as well.
Corporation icons! Now we can render the dynamic corp icons and display them.
Use of in-game roles for Starbase Caretaker. (Replaces the former POS delegation system.)
Assignment of POSes to individual owners. (To track corp vs. private POSes. Comon in 0.0 regions where everyone seems to own a POS.)
Use of memcached for caching.
Massive re-write for all backend processes to handle the scale of the Widget. (Parallel threads == Things that used to take over a hour to refresh now load in 6 minutes.)

Small changes

Fix display bug with total POS loss.
POSes now display grouped by owner.
Tranquility status now via API. (As per CCP request.)
POS runtime now stored in DB for faster POS list view. More data to be precomputed in future versions.
Overlapping buy/sell prices should now be not overlapping.
Stations now show corp icon for owner.
QTR mineral prices dropped as no longer seem accurate.

2008-11-17

Bug Fixes

API refresh fixed!!!

Work around new API bug with certificates. (Missing 'columns' attribute.)
Work around the non-alliance corporate refresh bug. (Now loads play corps that are not in an alliance successfully.)

2008-09-23

Corp refresh bug

There's currently a bug with non-alliance corporations being unable to be queried. A bug has been filed with CCP and a fix will hopefully be soon.

Big changes

Fix most causes of developer error messages. (Crashes)

Fixes

Update eveapi.py to 1.0.6.
POS View: Skip missing corporations. (Avoid crashing on CCP bug.)
Character refresh: Report socket and network errors.
User creation: Avoid crashes on missing password2 field.
Fix errors preventing map reload (datetime vs date objects).

2008-03-27

Big Changes:

POS views restored. (Thank you CCP for taking two weeks to fix a one-line bug.)

Little Changes:

Fix developer error pagess generated by the login password being wrong.

2008-03-19

Big Changes:

POS views disabled until CCP can fix the API.
View for Tranquility server status.
Fix API refresh for directors of corporations. (Was caused by POS API breaking.)
Add password recovery option so people that lost their password (Cough...) can reset it.
Moved EVE Widget to new hosting provider. (Better pricing and more room to grow.)

Little Changes:

New icons for some shiptypes from the EVE Killboard project.
Fix errors on empty fields for salvage calculator.

2008-02-29

Big Changes:

POSes can now have reactions assigned to them. This will then show full profit modeling for POS reactions, based on materials consumed, output materials, and fuel consumed.
Strontium need is now calculated for POS towers.
Index loader from EVE Central now uses system, not region, prices.

Little Changes:

Remove spare ending div tag from base.html
Solar system view now shows security class.
Calculate output m3 for reactions.
Different views for POS profits and fuel now.
Fix showing of alliance icons on region list.
POSes now have fields for being personal and having owners/maintainers. (Not yet implemented in views.)
Fixed reaction data in database.

2008-02-28

Big Changes:

IGB-compatability. many of the views, but not all, now work in-game. the pages that don't 'work', just have cosmetic issues really.
Refresh log now available on account view.

Little Changes:

Redirect to main menu on login.
Little CSS changes.
Typos fixed in a few places.
Support for asking for IGB trust. (To be used by mining op and other views later.)

2008-02-22

Lots of little changes:

First pass at browser identification. (Not that I do much with it at the moment.)
Blueprints now have nicer URLs for editing.
Added per-run costs to BPOs. (For copies really.)
Lots of little CSS changes.
Blueprints can now be deleted.
Blueprints per-run cost is now included in the manufacturing estimate.
Defunct alliances can now be deleted by the api-loader.
Slug fields added for lots of things.
Regions now list by slug.
Alliances now have slugs, but there's a duplicate.
Log a user in on account creation.
Redirect to account refresh on account creation.
Add a logout link to the top menu.
Fix corporation refresh on new accounts.

2008-02-21

Big Changes:

Add download of journal entries and display them mixed in with the transaction list. 'Boring' entries are not shown.
Account refresh now moved into main model code, and called immediately upon adding an account. Views exist to show you the results of that initial refresh.
Invalid/limited keys are now purged and email sent. (If email address is on file.)
Stale accounts (the user not logging in at all in 7 days) suspend refresh.
Loading of indexes for all four core regions from EVE Central.

Little Changes:

Email address now mandatory.
Remove book cost from manufacturing for those that need skills.
Set chargegroup icons on items to the group icon.
'POS Monkey' name changed to 'POS Helper' on character detail view.
Sort indexes by priority on item detail view.
Use slugs for items and marketgroups instead of IDs. (Much sexier URLs.)
Remove duplicate refinements from display on some items.
Move derived prices to their own index.
Better reporting of errors on user creation form.
Show URL on 404 template.
Fix a few small CSS issues.
Index note added to the top of the index detail view.
Email skipped if no email address provided. (Legacy accounts.)

2008-02-15

Big changes:

Added pos monkey role and per-tower delegations.
Email addresses are now required. (So we can poke you when you give us the wrong key.)

Little changes:

Automatic purging of grants if the character changes corporation.
Sort the fuels on the refuel page.
Sort the buildable rigs.
Improve verbage and layout on the POS detail view.
Fix api-loader.py choking on limited keys for users without an email address.

2008-02-14

Big Changes:

Rig calculator.
Users are forced to view the changelog if there's any new ones since their last login. :) (That's why you're reading this now.)
Users that mistakenly enter their limited key will now get an email when the loader runs letting them know it was the wrong one and deleting the limited key.

Little changes:

Got icons created for all the in-game factions. (Thanks FudgeIt!)
Simpler reaction browsing for POS reactions.
Stations that do not belong to an alliance now show the station type as their icon. (There are no corp icons in the dumps I'm afraid, even for NPC corps.)
Improved CSS for buttons and navbar. (Well, I think they are prettier.)
Show level/quantity for items that are used by the item being displayed. (Look at a piece of salvage, and it shows the quantity of that salvage needed for each rig you can build with it. Look at a skill, it shows the level you need for each thing that uses the skill.)

2008-02-10

Improvements to CSS so that all mobile and stand-alone browsers should now see a good layout. Font sizes now made adaptive, overall layout now specified in percentages rather than pixels.
Show icons and owners for regions.
Remove the Jove regions from the list. (You can't reach them.)

2008-02-02

Three big new features today:

POS Fuel calculator now shows your total need for fuel for all POSes and a shopping list for buying more.
Users can now manually refuel a tower.
Users can now create a customized personal price index that overrides the default ones.

And with luck, the new POS loader will be able to estimate the used CPU/power in a POS based on it's actual consumption rate vs. maximum rate.

2008-01-29

Big change: Personal price indexes. If you buy or sell any item, the widget will learn the values of these items for you and adjust shown values and computed costs for blueprints. Buy and sell minerals to set your mineral prices, and then all bluepritns will show very accurate prices. Then sellt he manufactured item and you'll see how much you can earned off of it.

Added descriptions to market groups and navigation links.

Bugfixes:

POS refresh timer fixed.
Able to change an API key on an existing account.

2008-01-28

POS loader now creates entries for all needed fuels when a pos is created. So no more missing fuel entries.
Stop showing negative time on time-to-refresh for POS detail view.
Show POS fuel consumption on item view.
Do not show perfect manufacture on item view if we have a blueprint. (Redundant really.)
Many attributes on an item will now be formatted much nicer.
Portion size on a blueprint now included on calculating cost when viewing blueprint. (Always was when viewing item. Just missing on blueprint side.)
Trim trailing 0 from times like '32m 0s'.
API loader remixed to load all accounts, then all characters, then all POSes. Cleaner and faster this way. And won't skip a POS jsut because the director is cached for another hour. (As it had been.)

2008-01-26

POS fuel consumption now includes sov level.
POS Detail view much improved.
Removed 'for iPhone' from the name. (People kept thinking it was useless without one.)
Fixed breadcrumbs for flatpages.
Can no longer add unpublished blueprints to your collection.
Blueprint edit views made more iPhone-ish.
CSS adjustments to owned blueprint list, POSes, and item blueprint block.
api-loader now skips over already-cached POSes, and users.
api-loader has command-line options now. (Seperate runs for map data vs. character data.)
Decomissioned POSes are now detected and deleted.
Deleted characters are now detected and deleted.
Accounts with API key failures are now purged after 12 hours.
Stack traces via email on 500's should now occur.
Tickets can now only be assigned to staff.
Blueprint copies now show up as copies when editing.

2008-01-25

Lots of small CSS changes.
Fixed refinement values for Lustering and Plush Alloys.
Show system name on trade history.

2008-01-18

Gave the user and account views a lot of love.
Added the ability for users to create their logins.
Added the ability for users to add/remove/edit API keys for their accounts.
Added security to most of the personal views.
Added names tot he transaction log.
Added refinement values and derived index values for most asteroid and compressed ore types.
Stop showing non-seeded blueprints.

2008-01-17

Lots of UI changes to items.
Show more of what items are used for what. (Did you know that Reports actually had a use?)
Show POS fuel at 0 if run out, not negative time.
Lots of little cleanups on item view.
Show index prices in more places.
Derive index prices for asteroid and alloy types.

2008-01-11

Added loading of map sov from EVE API.
Added loading of alliance list from EVE API.
Added loading of corporation details from EVE API.
Added lots of sov data to views everywhere.
Converted some views from definition lists to tables to appease IE's braindead understanding of CSS.
Added an experimental sov change tracker. (Shows last two weeks by default.)
Moved a lot of file serving from Django to Apache. (Much faster.)
Bugfixes to data loader to handle some odd cases.

More views on all the new data coming RealSoon(TM).

2008-01-03

Added a pretty good POS view including warnings for stations with less than 2 days of fuel.
A little bit of fuel-specific handling. (Stront is not shown as being consumed if the tower is not in reinforced.)

2008-01-01

Added corporation information to character model.
Added player corporations into the NPC Corporation table and names tables from CCP. (My sense of rightness prohibits me from having different tables for PC vs. NPC corps.)
Added corporation data to the API loader so as to populate above models.
Added API access to starbase list and details.
Added determination of being a corp director or not per user. (Based off being able to access starbase list.)
New data models for starbases and starbase fuels.
Added list and detail views for starbases.
Some misc CSS cleanups.
Added icons for top nav.

2007-12-31

Finally added the 'about' page. (People kept pointing out that it was missing.)

Added views for transaction lists and detail.

Changed the region page to look more iPhone-ish. (Got the stations and systems display to look a lot better.)

Cleanups to how the navigation elements read vs. the names when you were on them. (Titles didn't match nav descriptions always. Doubt anyone but me would ever notice.)

Added client field to transaction storage and updated api-loader to pull it.

2007-12-31

Added moon and asteroid belt count to the system list on constellation view.

Made the constellation page look much more iPhone-ish.

Show station name if only one station.

2007-12-29

Added views for regions, constellations and solar systems.

Updated DB to Trinity 1.0. (Lots of changes.)

Added loading of player corporations in api-loader.

Added loading of conquerable stations in api-loader. (That fixes a significant bug where trades in 0.0 stations would kill the loader.)

Automatic page titles on all pages. (For those like me that like to look at title bars.)

Renamed to 'EVE Magic Widget'.

Views now exist to see the currently used market index(es). (Still need to add more than one some day.)

Icons updated to Trinity set. (Only ships seem different to me, but whatever.)

2007-07-30

Ore refining now uses the materials structure instead of it's own.

Max_skill_level and trade_history made into UserProfile methods. (Had been part of the view.)

Finally added the addition and editing of owned blueprints. You can now add them from either the blueprint list, or from the item detail. (The blueprint list is also new.)

2007-07-27

Another reorg of the materials data structure so that the template can properly print it. (Impossible to do a dictionary lookup by the content of a variable in templates.)

Implementation of the UserProfile object. (Now I can move the data for some user-specific calculations there.)

Addition of index price to the material list, so users can see how it was calculated.

Ore refining loader now deletes data before loading, to avoid possible stale data.

Added ice refinement values. (And changed ice products to show what they refine from.)

Index loader now only keeps the most recent index. Date field is now used for last_update, not keeping multiples.

2007-07-26

Added isk value calculations for all types of material lists.

Refactored handling of material lists to better allow for further types to be returned.

Added best case manufacture -> sale profit.

Enabled the 'markdown' library and filter item descriptions and changelogs through it for better formatting.

2007-07-25

Fixed font for API key on character screen so it's readable.

Added reprocessing data for 'Refinables' and changed those items to show that data.

Fixed bugs around the calculation of the 'best' deals.

Minerals now shown the per-unit refined amounts, whereas the ores show per-batch.

2007-07-24

Added skill level to item attribute display. (Used to be just the name. They are actually two different attributes.)

Formatted mineral values with commas. (Fixed bug with comma function and integers.)

Loaded new CCP dump.

Added refining values for all basic ores. (Still need ice ores.)

Added portion size to attribute display.

2007-07-22

Added per-user manufacturing.

Cleaned up the blueprint sections on item display. (One section now instead of 3)

Skill training time now shows time remaining, not time of completion.

Blueprint ownership now in admin pages. (Still need user pages.)

2007-07-20

Added changelog database table.

Added main navigation page.

Added API access to skill training.

Added skill training to character list.

Added last refresh to character list.