[=;268562]
I am a bit curious about the trello voting. What is the threshold for ‘fast tracking’ items to the marketplace?
For example, one: advanced-dissolve-fx has 100 votes and has been on the trello for 4 weeks; yet it still hasn’t been approved (it will need to wait the entire month? And then wait until it gets slotted into a release week?)
[/]
The rough threshold for fast-tracking used to be roughly 30 votes, but it depends on the category. But since GDC and UE4 going free, that changed substantially. Before GDC it would take around a month to get 30 votes, and after GDC you can get that in a day or two. Right now we’re finding out what the new threshold should be, and if there’s going to be a dropoff in votes after the GDC bump.
Now, here’s the behind-the-scenes bit: fast-tracking happens around 30 votes, where we privately email the submitter and start getting the legal and financial paperwork signed. can be very time-consuming, taking from days to weeks. So that happens while voting is still going! At point we also encourage them to start advertising and getting more votes and bumping up interest in advance of the release.
[]
Now that files are required to be submitted for QA by EPIC before even reaching the trello, why have the trello at all? If assets are deemed of high enough quality by EPIC internal why wait any longer?
[/]
Building public interest, working with the community, and advertising. My idealized vision for the Marketplace is to help turn it into an incubator for entrepreneurs so people can learn how to build an advertising campaign, drum up community support, and to apply effort within that voting time window so their release can really pop. I work behind the scenes with sellers to encourage . We’re still trying to improve system, and it’s entirely possible that Trello may not be the best way to keep doing it.
[]
You mentioned 27 assets passed the internal QA bar you’ve set. If we continue the pace of about 5 assets per week some of that stuff won’t see the light of day until the middle of May even though it is ready NOW.
I guess what I am saying is I can not think of any legitimate reason for the wait.
[/]
Actually, they’re far from ready at that point. Just because a submission comes in doesn’t mean it’s ready to publish immediately. As I said above, the legal and financial paperwork for new sellers can take from days to weeks. And when we do QA on the packs and find problems with the content and request changes, that also takes days to weeks to fix. Sometimes it happens quickly, and sometimes it’s slow. It depends on the nature of the feedback we send and how long it takes to set up and fix. I know that people have day jobs and work on Marketplace content when they have time, so real life is definitely a factor.
And in many cases, submitters simply don’t respond even after multiple emails. There are probably 75+ submissions I can think of where I had to email submitters 2 to 4 times over the course of a month or two just to get them to respond, even if I’ve requested their files, or even if we’re ready to publish. One submitter with multiple packs that we were ready to publish accidentally filtered our emails into a folder he never checked, and we had to chase them for two months before we figured out what happened. In cases like , even if we’re ready to publish the content immediately, there’s really nothing I can do but keep emailing them and hoping they’ll respond.
Here’s an important, behind-the-scenes look at QA: We do read the forums, and we get emails and PMs about different sellers’ content and bugs that are in them. We also frequently update submitted content for bug fixes and to add new features. Each time happens, we get a better idea of common issues and bugs to look for and test in our QA process, so we can avoid releasing content that has problems like . is precisely why we do QA before Trello and work with submitters to fix these issues before it goes to public voting.
We’ve had cases where we’ve realized too late that some content is simply broken and not able to be fixed in time for the planned release, if ever. But if the public has already seen it and voted on it, whatever we decide to do is probably going to disappoint someone. Our choices are basically 1) reject it after people were looking forward to buying it, 2) delay it indefinitely at the last minute until the submitter can fix it, or 3) allow the release of something sub-par that’s going to upset paying customers.
So what looks like a slower intake right now is actually saving a substantial amount of time later for developers buying Marketplace content. We definitely take a hit on the perception of being slow to publish content, but ultimately I think the best thing to do in order to ensure quality. So we have to aggressively seek every way to speed up the process that we can. And we do, and we’re always trying to get better and release more, as long as we can maintain quality.
[]
I’m sure the majority of users don’t even know about the trello voting. I know epic wants to grow into a big marketplace like Unity Asset Store, but wants it to be of higher quality (justifiably so). The internal QA check by EPIC filters to ensure quality so I think it is time to open up the flood gates . If we limit ourselves to about 5 assets a week making the marketplace, we’re limiting content creators, content consumers, and UE4 projects in general.
[/]
I do agree on that point. In the coming weeks I’m wanting to push the weekly release up toward 10 releases each week to start. We’re also honestly thinking about whether or not Trello is still the best way to handle public input on the Marketplace. It does technically add up to four weeks to the submission time for each asset. If the community becomes satisfied enough with the QA process Epic goes through and the approval process for choosing what’s published, maybe we could find another way to get community input. The main balance we’re trying to find there is that if we ever do move away from Trello, we want to maintain community involvement in a way that is honest and really means something. And we’re always open to listening.
I really appreciate you taking the time to give your feedback, and that goes for everyone else here. If you didn’t care, you wouldn’t say anything at all, and we want to return that respect.