Joshua
open source statistical hierarchical phrase-based machine translation system
 All Classes Namespaces Functions Variables Typedefs Enumerations Enumerator Friends
lm::ngram::ProbingVocabulary Class Reference

#include <vocab.hh>

Inheritance diagram for lm::ngram::ProbingVocabulary:
[legend]
Collaboration diagram for lm::ngram::ProbingVocabulary:
[legend]

List of all members.

Classes

struct  IdentityHash

Public Member Functions

 ProbingVocabulary ()
WordIndex Index (const StringPiece &str) const
WordIndex Bound () const
void SetupMemory (void *start, std::size_t allocated, std::size_t entries, const Config &config)
void ConfigureEnumerate (EnumerateVocab *to, std::size_t max_entries)
WordIndex Insert (const StringPiece &str)
void FinishedLoading (ProbBackoff *reorder_vocab)
bool SawUnk () const
void LoadedBinary (int fd, EnumerateVocab *to)

Static Public Member Functions

static size_t Size (std::size_t entries, const Config &config)

Private Types

typedef util::ProbingHashTable
< util::ByteAlignedPacking
< uint64_t, WordIndex >
, IdentityHash
Lookup

Private Attributes

Lookup lookup_
WordIndex available_
bool saw_unk_
EnumerateVocabenumerate_

Member Typedef Documentation


Constructor & Destructor Documentation


Member Function Documentation

void lm::ngram::ProbingVocabulary::ConfigureEnumerate ( EnumerateVocab to,
std::size_t  max_entries 
)

Here is the call graph for this function:

Here is the call graph for this function:

WordIndex lm::ngram::ProbingVocabulary::Index ( const StringPiece str) const [virtual]

Implements lm::base::Vocabulary.

Here is the call graph for this function:

Here is the caller graph for this function:

Here is the call graph for this function:

Here is the call graph for this function:

void lm::ngram::ProbingVocabulary::SetupMemory ( void *  start,
std::size_t  allocated,
std::size_t  entries,
const Config config 
)
std::size_t lm::ngram::ProbingVocabulary::Size ( std::size_t  entries,
const Config config 
) [static]

Here is the call graph for this function:


Member Data Documentation