Value-wise ConvNet for Transformer Models: An Infinite Time-aware Recommender System

Mohsen Saaki, Saeid Hosseini, Sana Rahmani, M. Reza Kangavari, Wen Hua, Xiaofang Zhou

Research output: Journal article publicationJournal articleAcademic researchpeer-review

2 Citations (Scopus)


Finding the most suitable individual to answer a question using brief content has important usages, including the community of question answering systems and online recommender frameworks. However, one must tackle challenges: Disregarding the indispensable noise in short text contents, authors usually answer the input query with mismatched words that can negatively influence the textual relevance. Moreover, many vocabularies imply various alterations. Finally, not every expert is eager to answer an input query given the time constraint, named the reluctance dilemma. To overcome the challenges, we devise a novel embedding approach that constructs context-aware vectors. We then extract the knowledge domains out of the online contextual content. While we track user textual-temporal behavioral patterns via an infinite continuous-time module, we recommend a set of experts pertinent to the given query and willingly provide the response during the expected time. Experimental results on two real-world datasets of <italic>StackOverflow</italic> and <italic>Yahoo</italic> show that our online time-sensitive value-wise transformer can achieve higher effectiveness and efficiency versus other trending rivals in online expert recommendation systems. In addition, we empirically experience that Fourier transformers can automatically infer multi-aspect base signals and overpass manual discrete-time models in obtaining time-specific user profiles.

Original languageEnglish
Pages (from-to)1-12
Number of pages12
JournalIEEE Transactions on Knowledge and Data Engineering
Publication statusPublished - Nov 2022
Externally publishedYes


  • Behavioral sciences
  • context-wise transformers
  • Correlation
  • History
  • online expert recommendation
  • Question answering (information retrieval)
  • Recommender systems
  • Semantics
  • time-aware embedding
  • Transformers
  • user behavioral patterns

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Artificial Intelligence


Dive into the research topics of 'Value-wise ConvNet for Transformer Models: An Infinite Time-aware Recommender System'. Together they form a unique fingerprint.

Cite this