-
Notifications
You must be signed in to change notification settings - Fork 7
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Please provide us with the following information:
This issue is for a: (mark with an x
)
- [ x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)
Minimal steps to reproduce
Use the CsvHelper tool to read a 12G CSV file.
Generate an instance of "GremlinEdge" and pass it to graphBulkExecutor.BulkImportAsync().
Any log messages given by the failure
Without any feedback, after running for a while, the program gets stuck.
Expected/desired behavior
I hope it can run without getting stuck.
Mention any other details that might be useful
Here is my code:
var gremlinElements = new List<IGremlinElement>();
List<GremlinEdge> gremlinEdges = new List<GremlinEdge>();
var config = new CsvConfiguration(CultureInfo.InvariantCulture)
{
HasHeaderRecord = false,
};
using (var reader = new StreamReader(filePath))
using (var csv = new CsvReader(reader, config))
{
var relations = csv.GetRecords<Relation>();
foreach (var relation in relations)
{
cur_e++;
GremlinEdge e = new GremlinEdge(
"e" + cur_e,
relation.Label,
relation.Src_id,
relation.Tar_id,
"Person",
"Person",
relation.Src_id,
relation.Tar_id);
e.AddProperty("type", relation.type);
gremlinEdges.Add(e);
if(cur_e%100000==0)
{
Console.WriteLine("******"+cur_e.ToString());
gremlinElements.AddRange(gremlinEdges);
bulkOperationResponse = await graphBulkExecutor.BulkImportAsync(
gremlinElements: gremlinElements,
enableUpsert: true);
gremlinEdges=new List<GremlinEdge>();
}
}
}
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working