Logo ROOT  
Reference Guide
 
Loading...
Searching...
No Matches
ROOT::Experimental::RNTupleFillContext Class Reference

A context for filling entries (data) into clusters of an RNTuple.

An output cluster can be filled with entries. The caller has to make sure that the data that gets filled into a cluster is not modified for the time of the Fill() call. The fill call serializes the C++ object into the column format and writes data into the corresponding column page buffers. Writing of the buffers to storage is deferred and can be triggered by FlushCluster() or by destructing the context. On I/O errors, an exception is thrown.

Instances of this class are not meant to be used in isolation and can be created from an RNTupleParallelWriter. For sequential writing, please refer to RNTupleWriter.

Definition at line 52 of file RNTupleFillContext.hxx.

Public Member Functions

 ~RNTupleFillContext ()
 
void CommitStagedClusters ()
 Logically append staged clusters to the RNTuple.
 
std::unique_ptr< ROOT::REntryCreateEntry () const
 
std::unique_ptr< Detail::RRawPtrWriteEntryCreateRawPtrWriteEntry () const
 
void EnableMetrics ()
 
void EnableStagedClusterCommitting (bool val=true)
 
std::size_t Fill (Detail::RRawPtrWriteEntry &entry)
 Fill an RRawPtrWriteEntry into this context.
 
std::size_t Fill (ROOT::REntry &entry)
 Fill an entry into this context.
 
void FillNoFlush (Detail::RRawPtrWriteEntry &entry, ROOT::RNTupleFillStatus &status)
 Fill an RRawPtrWriteEntry into this context, but don't commit the cluster.
 
void FillNoFlush (ROOT::REntry &entry, ROOT::RNTupleFillStatus &status)
 Fill an entry into this context, but don't commit the cluster.
 
void FlushCluster ()
 Flush so far filled entries to storage.
 
void FlushColumns ()
 Flush column data, preparing for CommitCluster or to reduce memory usage.
 
ROOT::NTupleSize_t GetLastFlushed () const
 Return the entry number that was last flushed in a cluster.
 
const Detail::RNTupleMetricsGetMetrics () const
 
const ROOT::RNTupleModelGetModel () const
 
ROOT::NTupleSize_t GetNEntries () const
 Return the number of entries filled so far.
 
bool IsStagedClusterCommittingEnabled () const
 

Private Member Functions

 RNTupleFillContext (const RNTupleFillContext &)=delete
 
 RNTupleFillContext (std::unique_ptr< ROOT::RNTupleModel > model, std::unique_ptr< ROOT::Internal::RPageSink > sink)
 
template<typename Entry >
std::size_t FillImpl (Entry &entry)
 
template<typename Entry >
void FillNoFlushImpl (Entry &entry, ROOT::RNTupleFillStatus &status)
 
RNTupleFillContextoperator= (const RNTupleFillContext &)=delete
 

Private Attributes

ROOT::NTupleSize_t fLastFlushed = 0
 
std::size_t fMaxUnzippedClusterSize
 Limit for committing cluster no matter the other tunables.
 
Detail::RNTupleMetrics fMetrics
 
std::unique_ptr< ROOT::RNTupleModelfModel
 Needs to be destructed before fSink.
 
std::uint64_t fNBytesFilled = 0
 The total number of bytes filled into all the so far committed clusters, i.e.
 
std::uint64_t fNBytesFlushed = 0
 The total number of bytes written to storage (i.e., after compression)
 
ROOT::NTupleSize_t fNEntries = 0
 
std::unique_ptr< ROOT::Internal::RPageSinkfSink
 
bool fStagedClusterCommitting = false
 Whether to enable staged cluster committing, where only an explicit call to CommitStagedClusters() will logically append the clusters to the RNTuple.
 
std::vector< ROOT::Internal::RPageSink::RStagedClusterfStagedClusters
 Vector of currently staged clusters.
 
std::size_t fUnzippedClusterSize = 0
 Keeps track of the number of bytes written into the current cluster.
 
std::size_t fUnzippedClusterSizeEst
 Estimator of uncompressed cluster size, taking into account the estimated compression ratio.
 

Friends

class RNTupleParallelWriter
 
class ROOT::RNTupleWriter
 

#include <ROOT/RNTupleFillContext.hxx>

Constructor & Destructor Documentation

◆ RNTupleFillContext() [1/2]

ROOT::Experimental::RNTupleFillContext::RNTupleFillContext ( std::unique_ptr< ROOT::RNTupleModel > model,
std::unique_ptr< ROOT::Internal::RPageSink > sink )
private

Definition at line 29 of file RNTupleFillContext.cxx.

◆ RNTupleFillContext() [2/2]

ROOT::Experimental::RNTupleFillContext::RNTupleFillContext ( const RNTupleFillContext & )
privatedelete

◆ ~RNTupleFillContext()

ROOT::Experimental::RNTupleFillContext::~RNTupleFillContext ( )

Definition at line 44 of file RNTupleFillContext.cxx.

Member Function Documentation

◆ CommitStagedClusters()

void ROOT::Experimental::RNTupleFillContext::CommitStagedClusters ( )

Logically append staged clusters to the RNTuple.

Definition at line 93 of file RNTupleFillContext.cxx.

◆ CreateEntry()

std::unique_ptr< ROOT::REntry > ROOT::Experimental::RNTupleFillContext::CreateEntry ( ) const
inline

Definition at line 150 of file RNTupleFillContext.hxx.

◆ CreateRawPtrWriteEntry()

std::unique_ptr< Detail::RRawPtrWriteEntry > ROOT::Experimental::RNTupleFillContext::CreateRawPtrWriteEntry ( ) const
inline

Definition at line 151 of file RNTupleFillContext.hxx.

◆ EnableMetrics()

void ROOT::Experimental::RNTupleFillContext::EnableMetrics ( )
inline

Definition at line 170 of file RNTupleFillContext.hxx.

◆ EnableStagedClusterCommitting()

void ROOT::Experimental::RNTupleFillContext::EnableStagedClusterCommitting ( bool val = true)
inline

Definition at line 161 of file RNTupleFillContext.hxx.

◆ Fill() [1/2]

std::size_t ROOT::Experimental::RNTupleFillContext::Fill ( Detail::RRawPtrWriteEntry & entry)
inline

Fill an RRawPtrWriteEntry into this context.

This method will check the entry's model ID to ensure it comes from the context's own model or throw an exception otherwise.

Returns
The number of uncompressed bytes written.

Definition at line 139 of file RNTupleFillContext.hxx.

◆ Fill() [2/2]

std::size_t ROOT::Experimental::RNTupleFillContext::Fill ( ROOT::REntry & entry)
inline

Fill an entry into this context.

This method will check the entry's model ID to ensure it comes from the context's own model or throw an exception otherwise.

Returns
The number of uncompressed bytes written.

Definition at line 125 of file RNTupleFillContext.hxx.

◆ FillImpl()

template<typename Entry >
std::size_t ROOT::Experimental::RNTupleFillContext::FillImpl ( Entry & entry)
inlineprivate

Definition at line 100 of file RNTupleFillContext.hxx.

◆ FillNoFlush() [1/2]

void ROOT::Experimental::RNTupleFillContext::FillNoFlush ( Detail::RRawPtrWriteEntry & entry,
ROOT::RNTupleFillStatus & status )
inline

Fill an RRawPtrWriteEntry into this context, but don't commit the cluster.

The calling code must pass an RNTupleFillStatus and check RNTupleFillStatus::ShouldFlushCluster.

This method will check the entry's model ID to ensure it comes from the context's own model or throw an exception otherwise.

Definition at line 132 of file RNTupleFillContext.hxx.

◆ FillNoFlush() [2/2]

void ROOT::Experimental::RNTupleFillContext::FillNoFlush ( ROOT::REntry & entry,
ROOT::RNTupleFillStatus & status )
inline

Fill an entry into this context, but don't commit the cluster.

The calling code must pass an RNTupleFillStatus and check RNTupleFillStatus::ShouldFlushCluster.

This method will check the entry's model ID to ensure it comes from the context's own model or throw an exception otherwise.

Definition at line 121 of file RNTupleFillContext.hxx.

◆ FillNoFlushImpl()

template<typename Entry >
void ROOT::Experimental::RNTupleFillContext::FillNoFlushImpl ( Entry & entry,
ROOT::RNTupleFillStatus & status )
inlineprivate

Definition at line 84 of file RNTupleFillContext.hxx.

◆ FlushCluster()

void ROOT::Experimental::RNTupleFillContext::FlushCluster ( )

Flush so far filled entries to storage.

Definition at line 65 of file RNTupleFillContext.cxx.

◆ FlushColumns()

void ROOT::Experimental::RNTupleFillContext::FlushColumns ( )

Flush column data, preparing for CommitCluster or to reduce memory usage.

This will trigger compression of pages, but not actually write to storage.

Definition at line 58 of file RNTupleFillContext.cxx.

◆ GetLastFlushed()

ROOT::NTupleSize_t ROOT::Experimental::RNTupleFillContext::GetLastFlushed ( ) const
inline

Return the entry number that was last flushed in a cluster.

Definition at line 157 of file RNTupleFillContext.hxx.

◆ GetMetrics()

const Detail::RNTupleMetrics & ROOT::Experimental::RNTupleFillContext::GetMetrics ( ) const
inline

Definition at line 171 of file RNTupleFillContext.hxx.

◆ GetModel()

const ROOT::RNTupleModel & ROOT::Experimental::RNTupleFillContext::GetModel ( ) const
inline

Definition at line 149 of file RNTupleFillContext.hxx.

◆ GetNEntries()

ROOT::NTupleSize_t ROOT::Experimental::RNTupleFillContext::GetNEntries ( ) const
inline

Return the number of entries filled so far.

Definition at line 159 of file RNTupleFillContext.hxx.

◆ IsStagedClusterCommittingEnabled()

bool ROOT::Experimental::RNTupleFillContext::IsStagedClusterCommittingEnabled ( ) const
inline

Definition at line 168 of file RNTupleFillContext.hxx.

◆ operator=()

RNTupleFillContext & ROOT::Experimental::RNTupleFillContext::operator= ( const RNTupleFillContext & )
privatedelete

Friends And Related Symbol Documentation

◆ RNTupleParallelWriter

Definition at line 54 of file RNTupleFillContext.hxx.

◆ ROOT::RNTupleWriter

friend class ROOT::RNTupleWriter
friend

Definition at line 53 of file RNTupleFillContext.hxx.

Member Data Documentation

◆ fLastFlushed

ROOT::NTupleSize_t ROOT::Experimental::RNTupleFillContext::fLastFlushed = 0
private

Definition at line 63 of file RNTupleFillContext.hxx.

◆ fMaxUnzippedClusterSize

std::size_t ROOT::Experimental::RNTupleFillContext::fMaxUnzippedClusterSize
private

Limit for committing cluster no matter the other tunables.

Definition at line 73 of file RNTupleFillContext.hxx.

◆ fMetrics

Detail::RNTupleMetrics ROOT::Experimental::RNTupleFillContext::fMetrics
private

Definition at line 61 of file RNTupleFillContext.hxx.

◆ fModel

std::unique_ptr<ROOT::RNTupleModel> ROOT::Experimental::RNTupleFillContext::fModel
private

Needs to be destructed before fSink.

Definition at line 59 of file RNTupleFillContext.hxx.

◆ fNBytesFilled

std::uint64_t ROOT::Experimental::RNTupleFillContext::fNBytesFilled = 0
private

The total number of bytes filled into all the so far committed clusters, i.e.

the uncompressed size of the written clusters

Definition at line 71 of file RNTupleFillContext.hxx.

◆ fNBytesFlushed

std::uint64_t ROOT::Experimental::RNTupleFillContext::fNBytesFlushed = 0
private

The total number of bytes written to storage (i.e., after compression)

Definition at line 68 of file RNTupleFillContext.hxx.

◆ fNEntries

ROOT::NTupleSize_t ROOT::Experimental::RNTupleFillContext::fNEntries = 0
private

Definition at line 64 of file RNTupleFillContext.hxx.

◆ fSink

std::unique_ptr<ROOT::Internal::RPageSink> ROOT::Experimental::RNTupleFillContext::fSink
private

Definition at line 57 of file RNTupleFillContext.hxx.

◆ fStagedClusterCommitting

bool ROOT::Experimental::RNTupleFillContext::fStagedClusterCommitting = false
private

Whether to enable staged cluster committing, where only an explicit call to CommitStagedClusters() will logically append the clusters to the RNTuple.

Definition at line 79 of file RNTupleFillContext.hxx.

◆ fStagedClusters

std::vector<ROOT::Internal::RPageSink::RStagedCluster> ROOT::Experimental::RNTupleFillContext::fStagedClusters
private

Vector of currently staged clusters.

Definition at line 81 of file RNTupleFillContext.hxx.

◆ fUnzippedClusterSize

std::size_t ROOT::Experimental::RNTupleFillContext::fUnzippedClusterSize = 0
private

Keeps track of the number of bytes written into the current cluster.

Definition at line 66 of file RNTupleFillContext.hxx.

◆ fUnzippedClusterSizeEst

std::size_t ROOT::Experimental::RNTupleFillContext::fUnzippedClusterSizeEst
private

Estimator of uncompressed cluster size, taking into account the estimated compression ratio.

Definition at line 75 of file RNTupleFillContext.hxx.

Libraries for ROOT::Experimental::RNTupleFillContext:

The documentation for this class was generated from the following files: