Click here to Skip to main content
15,445,641 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.

 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 8:01
mvahoney the codewitch17-Dec-20 8:01 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Slacker00717-Dec-20 8:11
professionalSlacker00717-Dec-20 8:11 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 8:23
mvahoney the codewitch17-Dec-20 8:23 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Slacker00717-Dec-20 8:38
professionalSlacker00717-Dec-20 8:38 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 8:41
mvahoney the codewitch17-Dec-20 8:41 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Jörgen Andersson17-Dec-20 10:15
professionalJörgen Andersson17-Dec-20 10:15 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 10:18
mvahoney the codewitch17-Dec-20 10:18 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
PIEBALDconsult17-Dec-20 13:09
professionalPIEBALDconsult17-Dec-20 13:09 
I load 51GB of XML with what SSIS has built-in. It takes about twelve minutes.

I load 5GB of JSON with my own parser. It takes about eight minutes.
I load 80GB of JSON with my own parser -- this dataset has tripled in size over the last month. It's now taking about five hours.

These datasets are in no way comparable, I'm just comparing the size-on-disk of the files.

I will, of course, accept that my JSON loader is a likely bottleneck, but I have nothing else to compare it against. It seemed "good enough" two years ago when I had a year-end deadline to meet.
I may also be able to configure my JSON Loader to use BulkCopy, as I do for the 5GB dataset, but I seem to recall that the data wasn't suited to it.

At any rate, I'm in need of an alternative, but it can't be third-party.

Next year will be different.
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Jörgen Andersson18-Dec-20 6:19
professionalJörgen Andersson18-Dec-20 6:19 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
PIEBALDconsult18-Dec-20 8:21
professionalPIEBALDconsult18-Dec-20 8:21 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Jörgen Andersson18-Dec-20 8:24
professionalJörgen Andersson18-Dec-20 8:24 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch18-Dec-20 6:45
mvahoney the codewitch18-Dec-20 6:45 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
PIEBALDconsult17-Dec-20 8:44
professionalPIEBALDconsult17-Dec-20 8:44 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 8:44
mvahoney the codewitch17-Dec-20 8:44 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Nelek17-Dec-20 9:14
protectorNelek17-Dec-20 9:14 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Stuart Dootson17-Dec-20 23:51
professionalStuart Dootson17-Dec-20 23:51 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch18-Dec-20 0:37
mvahoney the codewitch18-Dec-20 0:37 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
John Stewien17-Dec-20 19:28
MemberJohn Stewien17-Dec-20 19:28 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Sander Rossel17-Dec-20 11:40
professionalSander Rossel17-Dec-20 11:40 
GeneralRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
honey the codewitch17-Dec-20 12:55
mvahoney the codewitch17-Dec-20 12:55 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Alexander Munro17-Dec-20 20:01
MemberAlexander Munro17-Dec-20 20:01 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Member 1330167917-Dec-20 20:22
MemberMember 1330167917-Dec-20 20:22 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Mehdi Gholam17-Dec-20 21:28
MemberMehdi Gholam17-Dec-20 21:28 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
obeobe17-Dec-20 23:26
Memberobeobe17-Dec-20 23:26 
AnswerRe: I'd like to ask a question about JSON to get a feel for priorities of coders here Pin
Member 1409260518-Dec-20 2:02
MemberMember 1409260518-Dec-20 2:02 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.


Straw Poll

What topics would you like to learn more about?
Contributed by Marc Clifton.
  Results   535 votes