. /../Noctis IV inbox! Now!/ 1234
r'lyeh sweet r'lyeh
written by Neuzd on Nov 23, 2008 17:19
Before getting too excited, let me explain.

I have just built a working inbox.zip in an automated way, from 3 different outboxes.
It looks that I figured it out the whole thing, but there is still something that has to be done.

First, I obviously worked with small outboxes I generated myself; I wasn't checking for errors or deleted entries or who knows what, so to fine tune my script I'd need several outboxes, possibly messy, to catch all the situations that can happen.

Second, if this turns out to work fine, I think I want Alex's approval for going on with this project.
Maybe I'll send him an email at the right time, if in the meantime our official modders (Megagun & Shadowlord and who else) have their ideas about this, let me know.

With the work I've done today, I also thought that maybe NICE inboxes could be revived, too.
Is it possible to have the SyncStarmap source to try to fix it myself, Megagun?

And by the way, this inbox work took me just a little offroad from my current project.
I hope to reveal my work, soon. The development is going pretty well at the moment : D

So, express your interest about this (though I have my prediction....), there are a lot of things to define, every question or suggestion is welcome.

Yours truly,
The Philosophientist Felysian
neuzd
written by Cryoburner on Nov 23, 2008 18:46
I sent you a PM with links to some outboxes that were submitted through the 'Tell Us' script in recent months.

Hopefully they'll be of some use. : )
r'lyeh sweet r'lyeh
written by Neuzd on Nov 23, 2008 23:35
Cryoburner said:
I sent you a PM with links to some outboxes that were submitted through the 'Tell Us' script in recent months.

Hopefully they'll be of some use. : )
Thanks a lot!
Just a quick update about these outboxes.
I extracted 266 valid names and 294 valid GUIDE notes.
55 notes seem to be assigned to objects not in the starmap, nor among the newly added names.
It may be fault of missing outboxes (but I have updated my Noctis IV with the latest official inbox) or of something else (...yes pretty much obvious).

I still didn't built/tried an inbox with these data, but I'm quite confident.
Now I need some sleep. Tomorrow I'm going to test it ingame.

[EDIT]
Oh yes, they appear to be all NIV outboxes...or at least they're in the same NIV format.
written by 4616599 on Nov 24, 2008 06:57
This is definitely groundbreaking news! Yes, I'm really starting to get excited about this and will probably boost my GOES console output!

About the outboxes I mentioned(and uploaded to the cdisk) in the other thread, do note that outbox_1 had already been submitted, while only a fragment of outbox__2 was submitted.

Anyway, excuse me for a moment... WOOHOO! YES! THE INBOXES ARE COMING BACK!
rose pony is best pony
written by Starchaser on Nov 26, 2008 08:07
I spent a couple of days on trying to merge a couple of outboxes but the notes didn't load everytime I got it to load the systems/planets...

Does anyone know how to avert this feature?
r'lyeh sweet r'lyeh
written by Neuzd on Nov 26, 2008 11:31
I'm doing fine. Just be patient.
r'lyeh sweet r'lyeh
written by Neuzd on Nov 26, 2008 22:41
Sorry for the double post but I made some serious tests and had pretty nice results.

One of the most reassuring things is that it seems that the INBOX program is quite smart (not that I doubted) and already checks for starmap entries that are total duplicates.

I used 8 different outboxes and 1 that was an expansion of one of the others.
So I had 9 files to be merged and I decided to try differrent filesets.

The first one was composed of 10 outboxes: the 9 I had + 1 exact duplicate.
The second fileset had only 8 files, taking just the most complete of the two sent by te same person.

Before jumping into the stardrifter I made a copy of the data folder.
This folder has been used as default "start point" for all the inboxes produced, so that all inboxes have been tried from the same exact gamestate.
I made several tests and restricted the interesting results to 2 inboxes, one for each fileset.

The most interesting thing, as I said, is that in both cases Noctis imported always the same amount of starmap entries and notes.
427 vs 442 names
628 vs 629 notes : )
The predicted numbers are of course those of my "clean" fileset.

So, to conclude in style here's some hot action.
These are names and notes sent in by 4616599 (you can check if everything seems familiar to you).

A freshly named star and relative notes



Planet of aforementioned star & notes



A note appended to those of an existing star (Sensenbrecht)



I think that it works.
: D
rawr
written by Raptorjedi on Nov 26, 2008 23:07
Have you tested it with the same star named two different things by two people? That does happen (on occasion. Just guessing, but I'd say it's happened maybe 30 times total.) so it's something to check.
written by 4616599 on Nov 27, 2008 02:09
Yes...I remember the system above...it was one of the first systems I named.

Things are definitely looking healthy so far, congrats!

By the way, the '1 that was an expansion of one of the others' was the outbox__2.zip that I uploaded to the cdisk, right?
( I'm just slightly worried that you may not have received my newer systems.)
rose pony is best pony
written by Starchaser on Nov 27, 2008 07:31
I'm sort of upset that you beat me to the punch. I don't know how long you have been working on this project (I must have missed the thread if you announced it) but I couldn't work on something similar due to moving house :\

Anyway, Jolly good show lads. Glad you have gotten this far and hope you go further.
r'lyeh sweet r'lyeh
written by Neuzd on Nov 27, 2008 08:48
4616599 said:
By the way, the '1 that was an expansion of one of the others' was the outbox__2.zip that I uploaded to the cdisk, right?
( I'm just slightly worried that you may not have received my newer systems.)
Sure.
8 files were forwarded by Cryo. I scrapped 2 from that list and substituted them with the latest versions you linked in the cdisk.

Starchaser said:
I don't know how long you have been working on this project
I guess pretty much everyone tried to mess up with the outboxes and the first time I tried was probably soon enough when I knew Noctis, one year ago, but I decided to have this working just last week.

The fact is that I didn't start this very project in total ignorance.
I made a lot of work on the other data files: starmap.bin, guide.bin and starmap2.bin.
It took me some time to figure it out that the most easy way to know how they were formatted was to read NIV source, with some help from the source code of EvolveSM and Peek's Starmapper.

When I successfully mastered these 3 files, I realized that the inbox & outbox shouldn't have been in a different format.
In fact they aren't.

More tests tonight.
I'm gonna check what happens with duplicates IDs, fakes IDs and (fear!) duplicate names.
r'lyeh sweet r'lyeh
written by Neuzd on Nov 27, 2008 23:39
More tests involving stars IDs anomalies.
These tests have been made hardcoding the data in the inbox, so I was having control of what I wanted to test.

Fortunately there's something handled by Noctis itself, the following cases all result in not imported data:
- naming already existing stars (Fenia & the likes)
- naming stars in the same inbox (that have been processed earlier than the current data)
- fake ids

One thing that Noctis doesn't do is checking for the same name given to different objects.
I've been told that Alex thought he had fixed this, but my tests revealed the opposite.

So, I modified my script to check the starmap and the current submissions that are being processed, to not include in the INBOX any entry with the same name of another object.

This modification had the interesting effect of alerting me that another couple of the outboxes I had, contained the same data.
As for 4616599's, one was an expansion of the other.

So, the new results are
(successfully imported vs inbox records)
427 vs 428 names
628 vs 629 notes

I can still read the files one by one and try to find at least which outbox the missing record comes from.
If it belongs to the small ones, it's also possible to find out what happened.

But with these results I feel in the mood of saying: "ownage".

[EDIT]
Just fixed an inbox/outbox typo.
└> last changed by Neuzd on November 28, 2008 at 00:03
written by Jaxe'd on Nov 27, 2008 23:45
Neuzd said:
But with these results I feel in the mood of saying: "ownage".
Hahaha!! Congrats, Neuzd! Keep up the good work!
lost, not forgotten
written by Alex on Dec 10, 2008 00:02
Neuzd said:
Second, if this turns out to work fine, I think I want Alex's approval for going on with this project.
Permission happily granted. I'd like to say more and perhaps add a news post to hint about what I've been doing recently, but the connection with this site doesn't seem to work right for me at this very moment. So that depends on what happens in the next hours.

I did two important things however: made Neuzd a moderator, so he could receive feedback forms and their attachments (outboxes), and posted here to confirm authorization on the project.
r'lyeh sweet r'lyeh
written by Neuzd on Dec 14, 2008 18:41
I think a new sticky thread will be opened about this....

Since then..ok I admit I'm just a bit excited to introduce things properly and just want to yell:

THE NEW INBOX IS AVAILABLE!
cd/zips/Neuzd/inbox_2008_12 (310 Kb)

It includes outboxes from 2005 to 2008.
On a clean StarMap version, results are:



Truly yours,
The StarMap Keeper.
reading this thread
no members are reading this thread
. /../Noctis IV inbox! Now!/ 1234
41767, 15 queries, 0.104 s.this frame is part of the AnyNowhere network