Black Lives Matter attempted to hold a memorial for victims of the slave trade, less than 100 people showed up