christoph/fail
1
Fork 0
Code Releases Activity

DatabaseCampaign: load completed pilots in memory

Browse Source 
This change makes the DatabaseCampaign load all pilot_ids from the result
table in memory instead of LEFT JOINing them for each variant.  This vastly
improves campaign speed (possibly making commit 5567c59 superfluous) at the
cost of slightly increased startup time for half-completed (large)
campaigns.

By exploiting the generally continuous nature of pilot IDs and using a
boost::icl::interval_map, the additional memory requirements are
insignificant.

Change-Id: I1e744fb9ca33efea77a2a785cea3c94106f360df
This commit is contained in:
Horst Schirmeier
2014-04-08 14:55:55 +02:00
parent a8611d1ec0
commit cfd99fe3af
2 changed files with 80 additions and 32 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
src/core/cpn/DatabaseCampaign.hpp
View File

@ -8,7 +8,9 @@
#include "comm/ExperimentData.hpp"
#include <google/protobuf/message.h>
#ifndef __puma
#include <boost/icl/interval_map.hpp>
#endif
namespace fail {
@ -27,6 +29,15 @@ class DatabaseCampaign : public Campaign {
int fspmethod_id; // !< Which fspmethod should be put out to the clients
void collect_result_thread();
void load_completed_pilots();
unsigned existing_results_for_pilot(unsigned pilot_id);
#ifndef __puma
typedef boost::icl::discrete_interval<unsigned>::type id_interval;
typedef boost::icl::interval_map<unsigned, unsigned>::type id_map;
typedef id_map::const_iterator id_iterator;
id_map completed_pilots; // !< map: Pilot IDs -> result count
#endif
public:
DatabaseCampaign() {};