Douglas Moore

On Databricks, we can store & analyze the graph and logs and join them too

Commented on Analyzing AWS Infrastructure for Offensive Tactics...·Posted inAsk

Donny W. a few use cases are foreseeable...

1.
Info-sec to give context to all of the log files and events being collected.
2.
IT Management - identify open doors, poor practices etc.
3.
Give context to the collected events and logs

Commented on Simplifying Ontology Alignment for Efficient Solut...·Posted inAsk

Interesting... Thanks

Finding AWS Scanning Tools: A Look at Altimeter

I'm ever hopeful someone has gone before and staked out a 'standard' I found Altimeter (https://github.com/tableau/altimeter) that does a good job of scanning AWS

If AWS has their own ontology, we could probably work with that

2Comments

Suggestions for User, Server, and Network Management Tools

It contains things for users, servers, networks, files etc... open to other suggestions Michael G.

Mapping AWS Infrastructure to RDFs: Resources and Guidance

I came here looking for resources for mapping AWS infrastructure (EC2, S3, IAM Roles, VPC, Subnets,...) to RDFs (https://d3fend.mitre.org/dao Ontology)

Commented on Exploring Data Integration and OLAP Queries with S...·Posted inAsk

Ok, I should have been more precise, it’s built on RDDs and not Dataframes.

Exploring Data Integration and OLAP Queries with Spark

Yong Tang. Great set of new references for me to look at, thank you! I’m on a similar quest… for data integration and OLAP type queries, powered by Spark over data in a data lake.

https://github.com/SANSA-Stack/SANSA-Stack is powered by Spark RDDs. This seems active but built on the older Spark 1.x RDD structure
OnTop VKG promises to map Sparql to SQL (thus query Big Data sql engines like Spark SQL)
S2RDF and some other papers on optimizing Sparql queries over Spark

7Comments

About

Job title
Location
Organization

Commented on If AWS has their own ontology, we could probably w...·Posted inAsk

Martynas J. Yes, finally found that blog, they create their own namespace, which is probably workable. I did patch it to work with my limited IAM role permissions but it runs well.

Commented on Analyzing AWS Infrastructure for Offensive Tactics...·Posted inAsk

On Databricks, we can store & analyze the graph and logs and join them too

Commented on Analyzing AWS Infrastructure for Offensive Tactics...·Posted inAsk

Donny W. a few use cases are foreseeable...

1.
Info-sec to give context to all of the log files and events being collected.
2.
IT Management - identify open doors, poor practices etc.
3.
Give context to the collected events and logs

Commented on Simplifying Ontology Alignment for Efficient Solut...·Posted inAsk

Interesting... Thanks

Finding AWS Scanning Tools: A Look at Altimeter

I'm ever hopeful someone has gone before and staked out a 'standard' I found Altimeter (https://github.com/tableau/altimeter) that does a good job of scanning AWS

If AWS has their own ontology, we could probably work with that

2Comments

Suggestions for User, Server, and Network Management Tools

It contains things for users, servers, networks, files etc... open to other suggestions Michael G.

Mapping AWS Infrastructure to RDFs: Resources and Guidance

I came here looking for resources for mapping AWS infrastructure (EC2, S3, IAM Roles, VPC, Subnets,...) to RDFs (https://d3fend.mitre.org/dao Ontology)

Commented on Exploring Data Integration and OLAP Queries with S...·Posted inAsk

Ok, I should have been more precise, it’s built on RDDs and not Dataframes.